00000001:02000400:2.0F:1788830352.415766:0:2964:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg121-server.virtnet: executing set_hostid 00000001:02000400:0.0F:1788830367.951391:0:3185:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg121-server.virtnet: executing load_modules_local 00000001:01000000:3.0F:1788830369.416857:0:3243:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 859 MB/s 00000001:01000000:2.0:1788830369.668439:0:3243:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 948 MB/s 00000001:01000000:3.0:1788830369.917808:0:3243:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 5431 MB/s 00000020:02000000:3.0:1788830370.777328:0:3277:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_104_ga33798f 00000400:02000000:3.0:1788830371.762030:0:3291:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.201.121@tcp [8/256/0/180] 00008000:02000000:0.0:1788830374.862109:0:3440:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:0.0:1788830421.850301:0:5241:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg121-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1788830431.150940:0:5813:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788830431.150945:0:5813:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1788830431.151367:0:5813:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000dfbf402d 00000080:02000400:3.0:1788830431.151379:0:5813:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:3.0:1788830431.155545:0:5813:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:3.0:1788830431.155559:0:5813:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1788830431.156421:0:5813:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (000000003bfdca09) 00000020:00000080:3.0:1788830431.156445:0:5813:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788830431.174307:0:5813:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1788830431.175329:0:5813:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1788830431.234253:0:5813:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1788830431.234283:0:5813:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788830431.234305:0:5813:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1788830431.234350:0:5813:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788830431.234364:0:5813:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1788830431.234631:0:5813:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1788830431.234640:0:5813:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788830431.234651:0:5813:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x575506951eea07d1 00000020:01000004:3.0:1788830431.234659:0:5813:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1788830431.234663:0:5813:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1788830431.234667:0:5813:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000dfbf402d from MGS 00000020:01000004:3.0:1788830431.234670:0:5813:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1788830431.234679:0:5813:0:(genops.c:413:class_newdev()) Allocate new device MGS (000000003b0aabb2) 00000020:00000080:3.0:1788830431.234689:0:5813:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1788830431.234784:0:5813:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000dfbf402d from MGS, refs=2 00080000:01000000:3.0:1788830431.234789:0:5813:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788830431.234794:0:5813:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x575506951eea07df 00000100:00100000:3.0:1788830431.234860:0:5813:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1788830431.235087:0:5813:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1788830431.235093:0:5813:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1788830431.236886:0:5813:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1788830431.236897:0:5813:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1788830431.237876:0:5813:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788830431.238131:0:5813:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1788830431.238136:0:5813:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1788830431.238681:0:5813:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1788830431.238688:0:5813:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1788830431.239088:0:5813:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1788830431.239094:0:5813:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0F:1788830431.239846:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788830431.239856:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788830431.239858:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788830431.240248:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788830431.240251:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788830431.240252:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788830431.241222:0:5813:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1788830431.243342:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:1.0:1788830431.491029:0:5813:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2463 MB/s 00000001:01000000:2.0:1788830431.740858:0:5813:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 3415 MB/s 00000001:01000000:2.0:1788830431.992297:0:5813:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 1031 MB/s 00000001:01000000:3.0:1788830432.241831:0:5813:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 803 MB/s 00080000:10000000:3.0:1788830432.248532:0:5813:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:3.0:1788830432.259084:0:5813:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1788830432.259103:0:5813:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788830432.259106:0:5813:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1788830432.260262:0:5823:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1788830432.260313:0:5813:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1788830432.260349:0:5813:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:0.0:1788830432.260537:0:5813:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1788830432.260564:0:5813:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1788830432.260929:0:5813:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788830432.261172:0:5813:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1788830432.261177:0:5813:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1788830432.266345:0:5813:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1788830432.266361:0:5813:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1788830432.269636:0:5813:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1788830432.269649:0:5813:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000100:00080000:0.0:1788830432.271009:0:5828:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:2.0:1788830432.271180:0:5813:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1788830432.271200:0:5813:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.201.121@tcp' 00000020:01000004:2.0:1788830432.271202:0:5813:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1788830432.271292:0:5813:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.201.121@tcp (typ=mgc) 00000020:00000080:2.0:1788830432.271313:0:5813:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.121@tcp (00000000374ea4d9) 00000020:00000080:2.0:1788830432.271331:0:5813:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1788830432.271463:0:5813:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000074fb958e@MGC192.168.201.121@tcp: add connection 192.168.201.121@tcp at head 00010000:00010000:2.0:1788830432.271631:0:5813:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.121@tcp-0 is initialized 00000040:01000000:2.0:1788830432.271637:0:5813:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.121@tcp ctxt 1 is initialized 10000000:01000000:2.0:1788830432.272235:0:5829:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1788830432.272303:0:5813:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.121@tcp (uuid 1745cc3d-3952-4cd4-9020-9b8acb483105) 00000020:00000080:0.0:1788830432.272320:0:5813:0:(genops.c:1385:class_connect()) connect: client 1745cc3d-3952-4cd4-9020-9b8acb483105, cookie 0x575506951eea07ed 00000100:00080000:0.0:1788830432.272331:0:5813:0:(import.c:510:import_select_connection()) MGC192.168.201.121@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788830432.272336:0:5813:0:(import.c:624:import_select_connection()) MGC192.168.201.121@tcp: import 0000000074fb958e using connection 192.168.201.121@tcp/0@lo 00000100:00100000:0.0:1788830432.272383:0:5813:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000072ea9313 x1875724595101824/t0(0) o250->MGC192.168.201.121@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788830432.272403:0:5813:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 1745cc3d-3952-4cd4-9020-9b8acb483105->MGS 00000020:01000004:0.0:1788830432.272419:0:5813:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1788830432.272423:0:5813:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1788830432.272437:0:5813:0:(genops.c:413:class_newdev()) Allocate new device MDS (0000000014285728) 00000020:00000080:0.0:1788830432.272445:0:5813:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1788830432.272797:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000072ea9313 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1745cc3d-3952-4cd4-9020-9b8acb483105:3306:1875724595101824:0@lo:250: 00000100:00100000:2.0:1788830432.272872:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830432.273414:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595101824 00000100:00100000:1.0:1788830432.273421:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595101824 00000100:00100000:1.0:1788830432.273461:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788830432.273465:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e7fc3308 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3306:x1875724595101824:12345-0@lo:250: 00010000:00080000:1.0:1788830432.273485:0:5824:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 1745cc3d-3952-4cd4-9020-9b8acb483105@0@lo t0 exp 0000000000000000 cur 185 last 0 00000020:00000080:1.0:1788830432.273512:0:5824:0:(genops.c:1385:class_connect()) connect: client 1745cc3d-3952-4cd4-9020-9b8acb483105, cookie 0x575506951eea07fb 00000100:00080000:1.0:1788830432.273638:0:5824:0:(import.c:65:import_set_state_nolock()) 00000000ae971916 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788830432.273728:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e7fc3308 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+5:3306:x1875724595101824:12345-0@lo:250: Request processed in 240us (836us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830432.273736:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788830432.273878:0:3306:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.201.121@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1788830432.273888:0:3306:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.201.121@tcp: connect to target with instance 0 00000100:00080000:2.0:1788830432.273894:0:3306:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.201.121@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1788830432.273898:0:3306:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1788830432.273909:0:3306:0:(import.c:65:import_set_state_nolock()) 0000000074fb958e MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1788830432.273912:0:3306:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1788830432.273920:0:3306:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1788830432.273924:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000072ea9313 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1745cc3d-3952-4cd4-9020-9b8acb483105:3306:1875724595101824:0@lo:250: 00000100:00100000:0.0:1788830432.287373:0:5813:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788830432.287605:0:5813:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1788830432.287620:0:5813:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00010000:00010000:1.0:1788830432.301925:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788830432.303147:0:5813:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1788830432.303161:0:5813:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1788830432.303630:0:5813:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1788830432.303637:0:5813:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1788830432.307292:0:5813:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788830432.307491:0:5813:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1788830432.307497:0:5813:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1788830432.310251:0:5813:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1788830432.310267:0:5813:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1788830432.360505:0:5813:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788830432.360782:0:5813:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1788830432.360789:0:5813:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1788830432.362672:0:5813:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1788830432.362683:0:5813:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1788830432.363817:0:5813:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788830432.364014:0:5813:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788830432.364020:0:5813:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1788830432.364921:0:5813:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788830432.364933:0:5813:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1788830432.366251:0:5813:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788830432.366439:0:5813:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788830432.366446:0:5813:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1788830432.367515:0:5813:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788830432.367526:0:5813:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1788830432.368561:0:5813:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788830432.369169:0:5813:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788830432.369176:0:5813:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1788830432.369631:0:5813:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788830432.369638:0:5813:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1788830432.408466:0:5813:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788830432.409171:0:5813:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788830432.409179:0:5813:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1788830432.412020:0:5813:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788830432.412037:0:5813:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1788830432.413811:0:5813:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1788830432.413827:0:5813:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1788830432.418234:0:5813:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1788830432.418272:0:5813:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:1.0:1788830432.418279:0:5813:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.121@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1788830432.418835:0:5813:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.121@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788830432.418890:0:5813:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.121@tcp, index=0000, flags=0x20065 00000020:01000004:1.0:1788830432.418896:0:5813:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788830432.418897:0:5813:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788830432.418907:0:5813:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788830432.418908:0:5813:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788830432.418909:0:5813:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788830432.418911:0:5813:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788830432.418913:0:5813:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788830432.418915:0:5813:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788830432.418916:0:5813:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788830432.418918:0:5813:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788830432.418919:0:5813:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788830432.418921:0:5813:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788830432.418923:0:5813:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:1.0:1788830432.418926:0:5813:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788830432.418927:0:5813:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788830432.418928:0:5813:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788830432.418929:0:5813:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788830432.418930:0:5813:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788830432.418931:0:5813:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788830432.418932:0:5813:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788830432.418933:0:5813:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788830432.418934:0:5813:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788830432.418934:0:5813:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788830432.418935:0:5813:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788830432.418936:0:5813:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788830432.418978:0:5813:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788830432.419012:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cea233e4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1745cc3d-3952-4cd4-9020-9b8acb483105:5813:1875724595101952:0@lo:253: 00000100:00100000:1.0:1788830432.419087:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830432.419143:0:5813:0:(client.c:2715:ptlrpc_set_wait()) set 0000000071c64e4d going to sleep for 11 seconds 00000100:00100000:0.0:1788830432.423131:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595101952 00000100:00100000:0.0:1788830432.423149:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595101952 00000100:00100000:0.0:1788830432.423269:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788830432.423280:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000b697034 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1745cc3d-3952-4cd4-9020-9b8acb483105+5:5813:x1875724595101952:12345-0@lo:253: 20000000:01000000:0.0:1788830432.423350:0:5827:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788830432.423354:0:5827:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:1.0:1788830432.431036:0:5848:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1788830432.431175:0:5827:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:0.0:1788830432.431508:0:5827:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788830432.432646:0:5849:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:2.0:1788830432.437130:0:5827:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788830432.437137:0:5827:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:2.0:1788830432.437155:0:5827:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:2.0:1788830432.437158:0:5827:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:2.0:1788830432.437174:0:5827:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:2.0:1788830432.437382:0:5827:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788830432.437584:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:2.0:1788830432.437596:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788830432.437635:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:2.0:1788830432.438507:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:2.0:1788830432.438561:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:2.0:1788830432.440253:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:2.0:1788830432.440276:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:2.0:1788830432.440347:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:2.0:1788830432.440356:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:2.0:1788830432.440388:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:2.0:1788830432.440395:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:2.0:1788830432.440458:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:2.0:1788830432.440513:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:2.0:1788830432.440580:0:5827:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1788830432.440587:0:5827:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:2.0:1788830432.440604:0:5827:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788830432.445069:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:3.0:1788830432.445109:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1788830432.445186:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:3.0:1788830432.445228:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:3.0:1788830432.445283:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:3.0:1788830432.445302:0:5827:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:3.0:1788830432.445432:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:3.0:1788830432.445441:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1788830432.445492:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:3.0:1788830432.445531:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:3.0:1788830432.445570:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:3.0:1788830432.445581:0:5827:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:3.0:1788830432.445671:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:3.0:1788830432.445688:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:3.0:1788830432.445747:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:3.0:1788830432.445786:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:3.0:1788830432.445983:0:5827:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:3.0:1788830432.446034:0:5827:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:3.0:1788830432.446043:0:5827:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:0.0:1788830432.450772:0:5850:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:3.0:1788830432.455221:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:3.0:1788830432.455255:0:5827:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.201.121@tcp for mdt 20000000:01000000:3.0:1788830432.455258:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.121@tcp (null) (null) (null) 00000040:00080000:3.0:1788830432.455514:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:3.0:1788830432.455525:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1788830432.455562:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:3.0:1788830432.455570:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.201.121@tcp (null) (null) 00000040:00080000:3.0:1788830432.455614:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:3.0:1788830432.455624:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:3.0:1788830432.455668:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:3.0:1788830432.455737:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:3.0:1788830432.455824:0:5827:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:3.0:1788830432.455828:0:5827:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1788830432.455831:0:5827:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1788830432.455843:0:5827:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788830432.455846:0:5827:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1788830432.455876:0:5827:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1788830432.455878:0:5827:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1788830432.460301:0:5851:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:0.0:1788830432.460699:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:0.0:1788830432.460800:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:0.0:1788830432.460878:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 20000000:01000000:0.0:1788830432.460893:0:5827:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788830432.460896:0:5827:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:0.0:1788830432.461531:0:5852:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:3.0:1788830432.461820:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:3.0:1788830432.461862:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:3.0:1788830432.461910:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:3.0:1788830432.461924:0:5827:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788830432.461927:0:5827:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:3.0:1788830432.461932:0:5827:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1788830432.461942:0:5827:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1788830432.461949:0:5827:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:3.0:1788830432.461955:0:5827:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:0.0:1788830432.462953:0:5853:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:3.0:1788830432.463138:0:5827:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:3.0:1788830432.475361:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:3.0:1788830432.475421:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:3.0:1788830432.475508:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:3.0:1788830432.475529:0:5827:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788830432.475554:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000ab0bf965/0x575506951eea0802 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830432.475573:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ab0bf965/0x575506951eea0802 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830432.475585:0:5827:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000ab0bf965/0x575506951eea0802 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830432.475593:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000ab0bf965/0x575506951eea0802 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830432.475600:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000ab0bf965/0x575506951eea0802 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830432.475606:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000ab0bf965/0x575506951eea0802 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830432.475611:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000ab0bf965 already unused, calling callback (00000000df09f092) 00010000:00010000:3.0:1788830432.475614:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000ab0bf965/0x575506951eea0802 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830432.475640:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000ab0bf965/0x575506951eea0802 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830432.475652:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000ab0bf965/0x575506951eea0802 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830432.475660:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000ab0bf965/0x575506951eea0802 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830432.475665:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000ab0bf965/0x575506951eea0802 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788830432.475684:0:5827:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1788830432.637040:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000b697034 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1745cc3d-3952-4cd4-9020-9b8acb483105+5:5813:x1875724595101952:12345-0@lo:253: Request processed in 213753us (217943us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830432.637059:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788830432.637070:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cea233e4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1745cc3d-3952-4cd4-9020-9b8acb483105:5813:1875724595101952:0@lo:253: 10000000:01000000:1.0:1788830432.637085:0:5813:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788830432.637088:0:5813:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788830432.637090:0:5813:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788830432.637091:0:5813:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788830432.637093:0:5813:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:1.0:1788830432.637094:0:5813:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788830432.637095:0:5813:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788830432.637097:0:5813:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788830432.637099:0:5813:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788830432.637100:0:5813:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1788830432.637102:0:5813:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788830432.637104:0:5813:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788830432.637137:0:5813:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000dfbf402d from lustre-MDT0000 10000000:01000000:1.0:1788830432.637158:0:5813:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1788830432.637161:0:5813:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788830432.637164:0:5813:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9e254482b370 10000000:01000000:1.0:1788830432.637167:0:5813:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788830432.637173:0:5813:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9e254482b370 from 1 10000000:01000000:1.0:1788830432.637175:0:5813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788830432.637206:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.121@tcp lock: 000000005cd528ab/0x575506951eea0809 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830432.637215:0:5813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.121@tcp lock: 000000005cd528ab/0x575506951eea0809 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830432.637221:0:5813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.121@tcp lock: 000000005cd528ab/0x575506951eea0809 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788830432.637234:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cea233e4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1745cc3d-3952-4cd4-9020-9b8acb483105:5813:1875724595102080:0@lo:101: 00000100:00100000:1.0:1788830432.637261:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830432.637352:0:5813:0:(client.c:2715:ptlrpc_set_wait()) set 000000006b6d30f6 going to sleep for 11 seconds 00000100:00100000:2.0:1788830432.637418:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595102080 00000100:00100000:2.0:1788830432.637424:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595102080 00000100:00100000:2.0:1788830432.637493:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788830432.637501:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000030e0a77b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1745cc3d-3952-4cd4-9020-9b8acb483105+5:5813:x1875724595102080:12345-0@lo:101: 00010000:00010000:2.0:1788830432.637514:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788830432.637528:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c9fe41fa/0x575506951eea0810 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x575506951eea0809 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830432.637554:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c9fe41fa/0x575506951eea0810 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x575506951eea0809 expref: 6 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830432.637561:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c9fe41fa/0x575506951eea0810 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x575506951eea0809 expref: 6 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830432.637573:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c9fe41fa, rc 0) 00000100:00100000:2.0:1788830432.637605:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000030e0a77b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1745cc3d-3952-4cd4-9020-9b8acb483105+6:5813:x1875724595102080:12345-0@lo:101: Request processed in 105us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830432.637611:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788830432.637634:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cea233e4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1745cc3d-3952-4cd4-9020-9b8acb483105:5813:1875724595102080:0@lo:101: 00010000:00010000:0.0:1788830432.637763:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.121@tcp lock: 000000005cd528ab/0x575506951eea0809 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea0810 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830432.637782:0:5813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.121@tcp lock: 000000005cd528ab/0x575506951eea0809 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x575506951eea0810 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788830432.637836:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000071544461 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1745cc3d-3952-4cd4-9020-9b8acb483105:5813:1875724595102208:0@lo:501: 00000100:00100000:0.0:1788830432.637894:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830432.637934:0:5813:0:(client.c:2715:ptlrpc_set_wait()) set 00000000bfdd447e going to sleep for 11 seconds 00000100:00100000:2.0:1788830432.638028:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595102208 00000100:00100000:2.0:1788830432.638031:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595102208 00000100:00100000:2.0:1788830432.638054:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788830432.638060:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000bc2bba5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1745cc3d-3952-4cd4-9020-9b8acb483105+6:5813:x1875724595102208:12345-0@lo:501: 00000100:00100000:2.0:1788830432.638318:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000bc2bba5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1745cc3d-3952-4cd4-9020-9b8acb483105+6:5813:x1875724595102208:12345-0@lo:501: Request processed in 258us (424us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788830432.638324:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788830432.638365:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000071544461 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1745cc3d-3952-4cd4-9020-9b8acb483105:5813:1875724595102208:0@lo:501: 10000000:01000000:0.0:1788830432.638384:0:5813:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.121@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788830432.638396:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: 000000005cd528ab/0x575506951eea0809 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea0810 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830432.638408:0:5813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.121@tcp lock: 000000005cd528ab/0x575506951eea0809 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea0810 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788830432.638414:0:5813:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9e255d9b0800 10000000:01000000:0.0:1788830432.638418:0:5813:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788830432.638421:0:5813:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9e255d9b0800 10000000:01000000:0.0:1788830432.638423:0:5813:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1788830432.638426:0:5813:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9e255d9b0800 from 1 10000000:01000000:0.0:1788830432.638428:0:5813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1788830432.638444:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.121@tcp lock: 00000000b0583775/0x575506951eea0817 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830432.638451:0:5813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.121@tcp lock: 00000000b0583775/0x575506951eea0817 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830432.638458:0:5813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.121@tcp lock: 00000000b0583775/0x575506951eea0817 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788830432.638490:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000071544461 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1745cc3d-3952-4cd4-9020-9b8acb483105:5813:1875724595102336:0@lo:101: 00000100:00100000:0.0:1788830432.638510:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830432.638524:0:5813:0:(client.c:2715:ptlrpc_set_wait()) set 00000000bfdd447e going to sleep for 11 seconds 00000100:00100000:2.0:1788830432.638543:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595102336 00000100:00100000:2.0:1788830432.638547:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595102336 00000100:00100000:2.0:1788830432.638577:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788830432.638583:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000000e96d7f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1745cc3d-3952-4cd4-9020-9b8acb483105+6:5813:x1875724595102336:12345-0@lo:101: 00010000:00010000:2.0:1788830432.638590:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788830432.638599:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000358a1257/0x575506951eea081e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x575506951eea0817 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830432.638613:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000358a1257/0x575506951eea081e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x575506951eea0817 expref: 7 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830432.638619:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000358a1257/0x575506951eea081e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x575506951eea0817 expref: 7 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830432.638623:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000358a1257, rc 0) 00000100:00100000:2.0:1788830432.638650:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000000e96d7f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1745cc3d-3952-4cd4-9020-9b8acb483105+7:5813:x1875724595102336:12345-0@lo:101: Request processed in 68us (139us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830432.638661:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788830432.638782:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000071544461 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1745cc3d-3952-4cd4-9020-9b8acb483105:5813:1875724595102336:0@lo:101: 00010000:00010000:0.0:1788830432.638792:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.121@tcp lock: 00000000b0583775/0x575506951eea0817 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea081e expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830432.638800:0:5813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.121@tcp lock: 00000000b0583775/0x575506951eea0817 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x575506951eea081e expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788830432.638810:0:5813:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.121@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1788830432.638827:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: 00000000b0583775/0x575506951eea0817 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea081e expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830432.638833:0:5813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.121@tcp lock: 00000000b0583775/0x575506951eea0817 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea081e expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788830432.638836:0:5813:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788830432.638839:0:5813:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788830432.638841:0:5813:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9e255d9b0800 10000000:01000000:0.0:1788830432.638843:0:5813:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1788830432.638845:0:5813:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1788830432.638846:0:5813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788830432.638862:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.121@tcp lock: 00000000dc17adae/0x575506951eea0825 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830432.638867:0:5813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.121@tcp lock: 00000000dc17adae/0x575506951eea0825 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830432.638879:0:5813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.121@tcp lock: 00000000dc17adae/0x575506951eea0825 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788830432.638887:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000071544461 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1745cc3d-3952-4cd4-9020-9b8acb483105:5813:1875724595102464:0@lo:101: 00000100:00100000:0.0:1788830432.638922:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830432.639003:0:5813:0:(client.c:2715:ptlrpc_set_wait()) set 00000000bfdd447e going to sleep for 11 seconds 00000100:00100000:3.0:1788830432.639040:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595102464 00000100:00100000:3.0:1788830432.639044:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595102464 00000100:00100000:3.0:1788830432.639068:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788830432.639074:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bd43daa3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1745cc3d-3952-4cd4-9020-9b8acb483105+7:5813:x1875724595102464:12345-0@lo:101: 00010000:00010000:3.0:1788830432.639080:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788830432.639087:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ab0bf965/0x575506951eea082c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x575506951eea0825 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830432.639100:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ab0bf965/0x575506951eea082c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x575506951eea0825 expref: 8 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830432.639108:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ab0bf965/0x575506951eea082c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x575506951eea0825 expref: 8 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830432.639114:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ab0bf965, rc 0) 00000100:00100000:3.0:1788830432.639195:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bd43daa3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1745cc3d-3952-4cd4-9020-9b8acb483105+8:5813:x1875724595102464:12345-0@lo:101: Request processed in 121us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830432.639203:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788830432.639246:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000071544461 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1745cc3d-3952-4cd4-9020-9b8acb483105:5813:1875724595102464:0@lo:101: 00010000:00010000:0.0:1788830432.639253:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.121@tcp lock: 00000000dc17adae/0x575506951eea0825 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea082c expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830432.639258:0:5813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.121@tcp lock: 00000000dc17adae/0x575506951eea0825 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x575506951eea082c expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788830432.639283:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000071544461 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1745cc3d-3952-4cd4-9020-9b8acb483105:5813:1875724595102592:0@lo:501: 00000100:00100000:0.0:1788830432.639299:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830432.639313:0:5813:0:(client.c:2715:ptlrpc_set_wait()) set 00000000bfdd447e going to sleep for 11 seconds 00000100:00100000:1.0:1788830432.639336:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595102592 00000100:00100000:1.0:1788830432.639340:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595102592 00000100:00100000:1.0:1788830432.639367:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788830432.639371:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b834adbb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+8:5813:x1875724595102592:12345-0@lo:501: 00000100:00100000:1.0:1788830432.639520:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b834adbb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+9:5813:x1875724595102592:12345-0@lo:501: Request processed in 148us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830432.639527:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788830432.639571:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000071544461 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1745cc3d-3952-4cd4-9020-9b8acb483105:5813:1875724595102592:0@lo:501: 00000100:00100000:0.0:1788830432.639596:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000071544461 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1745cc3d-3952-4cd4-9020-9b8acb483105:5813:1875724595102720:0@lo:503: 00000100:00100000:0.0:1788830432.639626:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830432.639672:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595102720 00000100:00100000:3.0:1788830432.639676:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595102720 00000100:00100000:3.0:1788830432.639704:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788830432.639789:0:5813:0:(client.c:2715:ptlrpc_set_wait()) set 00000000bfdd447e going to sleep for 11 seconds 00000100:00100000:2.0:1788830432.639953:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d67e9d81 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1745cc3d-3952-4cd4-9020-9b8acb483105+9:5813:x1875724595102720:12345-0@lo:503: 00000100:00100000:2.0:1788830432.640076:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d67e9d81 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1745cc3d-3952-4cd4-9020-9b8acb483105+9:5813:x1875724595102720:12345-0@lo:503: Request processed in 205us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830432.640082:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788830432.640107:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000071544461 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1745cc3d-3952-4cd4-9020-9b8acb483105:5813:1875724595102720:0@lo:503: 00000100:00100000:2.0:1788830432.640363:0:5856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000056bb9ada pname:cluuid:pid:xid:nid:opc:job llog_process_th:1745cc3d-3952-4cd4-9020-9b8acb483105:5856:1875724595102848:0@lo:502: 00000100:00100000:2.0:1788830432.640389:0:5856:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788830432.640408:0:5856:0:(client.c:2715:ptlrpc_set_wait()) set 0000000041fe2178 going to sleep for 11 seconds 00000100:00100000:1.0:1788830432.640447:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595102848 00000100:00100000:1.0:1788830432.640450:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595102848 00000100:00100000:1.0:1788830432.640502:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788830432.640509:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001c312b9e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1745cc3d-3952-4cd4-9020-9b8acb483105+9:5856:x1875724595102848:12345-0@lo:502: 00000100:00100000:1.0:1788830432.640671:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001c312b9e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1745cc3d-3952-4cd4-9020-9b8acb483105+9:5856:x1875724595102848:12345-0@lo:502: Request processed in 162us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830432.640678:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788830432.640744:0:5856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000056bb9ada pname:cluuid:pid:xid:nid:opc:job llog_process_th:1745cc3d-3952-4cd4-9020-9b8acb483105:5856:1875724595102848:0@lo:502: 00000020:01000000:3.0:1788830432.640767:0:5856:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788830432.640777:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788830432.640779:0:5856:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788830432.640785:0:5856:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1788830432.640787:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788830432.640799:0:5856:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (0000000097661850) 00000020:00000080:3.0:1788830432.640816:0:5856:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1788830432.640821:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788830432.640907:0:5856:0:(osd_handler.c:1573:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788830432.640913:0:5856:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x575506951eea083a 00000020:00000080:3.0:1788830432.641118:0:5856:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1788830432.641121:0:5856:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788830432.641124:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788830432.641125:0:5856:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788830432.641126:0:5856:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788830432.641129:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788830432.641129:0:5856:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1788830432.641131:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788830432.641136:0:5856:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000c50deead) 00000020:00000080:3.0:1788830432.641142:0:5856:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1788830432.641144:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788830432.641145:0:5856:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1788830432.641147:0:5856:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1788830432.641150:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788830432.641176:0:5856:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000dfbf402d from lustre-MDT0000, refs=3 00000020:00000080:3.0:1788830432.641187:0:5856:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000ce1ee0b6) 00000020:00000080:3.0:1788830432.641195:0:5856:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1788830432.641240:0:5856:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788830432.641244:0:5856:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x575506951eea084f 00000020:00000080:3.0:1788830432.641307:0:5856:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1788830432.641311:0:5856:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788830432.641314:0:5856:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x575506951eea0856 00080000:01000000:3.0:1788830432.641317:0:5856:0:(osd_handler.c:1573:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788830432.641319:0:5856:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x575506951eea085d 00080000:10000000:3.0:1788830432.641580:0:5856:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:3.0:1788830432.641819:0:5856:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:2.0:1788830432.645108:0:5856:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1788830432.690814:0:5856:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:2.0:1788830432.691210:0:5856:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:3.0:1788830432.697024:0:5856:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1788830432.697364:0:5856:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788830432.740706:0:5856:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (0000000013bf284e) 00000020:00000080:3.0:1788830432.740745:0:5856:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1788830432.740805:0:5856:0:(osd_handler.c:1573:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788830432.740818:0:5856:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x575506951eea086b 00000020:00000080:2.0:1788830432.741235:0:5856:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:2.0:1788830432.742734:0:5856:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:2.0:1788830432.790418:0:5856:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:0.0:1788830432.823191:0:5856:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:0.0:1788830432.864918:0:5856:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:1.0:1788830432.922434:0:5856:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:2.0:1788830433.004187:0:5856:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:2.0:1788830433.100682:0:5856:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x575506951eea0872 00000020:00000080:3.0:1788830433.104403:0:5856:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1788830433.104418:0:5856:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788830433.104425:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788830433.104428:0:5856:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1788830433.104431:0:5856:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788830433.104435:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788830433.104436:0:5856:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788830433.104440:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788830433.104442:0:5856:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788830433.104444:0:5856:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788830433.104447:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788830433.104448:0:5856:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788830433.104450:0:5856:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788830433.104454:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788830433.104456:0:5856:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1788830433.104460:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1788830433.104502:0:5856:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:3.0:1788830433.104573:0:5856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000f8a1d4e pname:cluuid:pid:xid:nid:opc:job llog_process_th:1745cc3d-3952-4cd4-9020-9b8acb483105:5856:1875724595102976:0@lo:502: 00000100:00100000:3.0:1788830433.104656:0:5856:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830433.104706:0:5856:0:(client.c:2715:ptlrpc_set_wait()) set 000000002a68d9eb going to sleep for 11 seconds 00000100:00100000:2.0:1788830433.104868:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595102976 00000100:00100000:2.0:1788830433.104875:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595102976 00000100:00100000:2.0:1788830433.104954:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788830433.104963:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a1fb3d26 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1745cc3d-3952-4cd4-9020-9b8acb483105+9:5856:x1875724595102976:12345-0@lo:502: 00000100:00100000:2.0:1788830433.105302:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a1fb3d26 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1745cc3d-3952-4cd4-9020-9b8acb483105+9:5856:x1875724595102976:12345-0@lo:502: Request processed in 340us (646us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830433.105311:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788830433.105364:0:5856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000f8a1d4e pname:cluuid:pid:xid:nid:opc:job llog_process_th:1745cc3d-3952-4cd4-9020-9b8acb483105:5856:1875724595102976:0@lo:502: 00000020:01000000:2.0:1788830433.105392:0:5856:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788830433.105403:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788830433.105405:0:5856:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:2.0:1788830433.105409:0:5856:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:0.0:1788830433.109285:0:5813:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:0.0:1788830433.109322:0:5813:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.121@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788830433.109364:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: 00000000dc17adae/0x575506951eea0825 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea082c expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830433.109377:0:5813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.121@tcp lock: 00000000dc17adae/0x575506951eea0825 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea082c expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788830433.109385:0:5813:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9e255d9b0800 from 1 10000000:01000000:0.0:1788830433.109388:0:5813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788830433.109425:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.121@tcp lock: 000000001626f271/0x575506951eea0879 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830433.109433:0:5813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.121@tcp lock: 000000001626f271/0x575506951eea0879 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830433.109443:0:5813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.121@tcp lock: 000000001626f271/0x575506951eea0879 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788830433.109466:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000071544461 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1745cc3d-3952-4cd4-9020-9b8acb483105:5813:1875724595103104:0@lo:101: 00000100:00100000:0.0:1788830433.109529:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830433.109658:0:5813:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d2809ef5 going to sleep for 11 seconds 00000100:00100000:2.0:1788830433.110885:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595103104 00000100:00100000:2.0:1788830433.110906:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595103104 00000100:00100000:2.0:1788830433.111001:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788830433.111011:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008d2d89a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1745cc3d-3952-4cd4-9020-9b8acb483105+9:5813:x1875724595103104:12345-0@lo:101: 00010000:00010000:2.0:1788830433.111027:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788830433.111043:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005f611a07/0x575506951eea0880 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x575506951eea0879 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830433.111069:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005f611a07/0x575506951eea0880 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x575506951eea0879 expref: 10 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830433.111079:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005f611a07/0x575506951eea0880 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x575506951eea0879 expref: 10 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830433.111086:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005f611a07, rc 0) 00000100:00100000:2.0:1788830433.111153:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008d2d89a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1745cc3d-3952-4cd4-9020-9b8acb483105+10:5813:x1875724595103104:12345-0@lo:101: Request processed in 144us (1624us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830433.111161:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788830433.111255:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000071544461 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1745cc3d-3952-4cd4-9020-9b8acb483105:5813:1875724595103104:0@lo:101: 00010000:00010000:1.0:1788830433.111271:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.121@tcp lock: 000000001626f271/0x575506951eea0879 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea0880 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830433.111279:0:5813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.121@tcp lock: 000000001626f271/0x575506951eea0879 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x575506951eea0880 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788830433.115248:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000014e5812d pname:cluuid:pid:xid:nid:opc:job mount.lustre:1745cc3d-3952-4cd4-9020-9b8acb483105:5813:1875724595103232:0@lo:256: 00000100:00100000:1.0:1788830433.115324:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830433.119640:0:5813:0:(client.c:2715:ptlrpc_set_wait()) set 00000000fad32af9 going to sleep for 11 seconds 00000100:00100000:0.0:1788830433.123273:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595103232 00000100:00100000:0.0:1788830433.123288:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595103232 00000100:00100000:0.0:1788830433.123355:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788830433.123364:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000364d7f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1745cc3d-3952-4cd4-9020-9b8acb483105+10:5813:x1875724595103232:12345-0@lo:256: 20000000:01000000:0.0:1788830433.123390:0:5827:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1788830433.123396:0:5827:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1788830433.123564:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000364d7f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1745cc3d-3952-4cd4-9020-9b8acb483105+10:5813:x1875724595103232:12345-0@lo:256: Request processed in 201us (8240us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830433.123572:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788830433.123745:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000014e5812d pname:cluuid:pid:xid:nid:opc:job mount.lustre:1745cc3d-3952-4cd4-9020-9b8acb483105:5813:1875724595103232:0@lo:256: 10000000:01000000:1.0:1788830433.124651:0:5813:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.121@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788830433.124869:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: 000000001626f271/0x575506951eea0879 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea0880 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830433.124897:0:5813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.121@tcp lock: 000000001626f271/0x575506951eea0879 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea0880 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788830433.124912:0:5813:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e255d9b0800 from 1 10000000:01000000:1.0:1788830433.124915:0:5813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788830433.124969:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.121@tcp lock: 000000000d1128c3/0x575506951eea0887 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830433.124983:0:5813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.121@tcp lock: 000000000d1128c3/0x575506951eea0887 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830433.124997:0:5813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.121@tcp lock: 000000000d1128c3/0x575506951eea0887 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788830433.125027:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000014e5812d pname:cluuid:pid:xid:nid:opc:job mount.lustre:1745cc3d-3952-4cd4-9020-9b8acb483105:5813:1875724595103360:0@lo:101: 00000100:00100000:1.0:1788830433.125104:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830433.125175:0:5813:0:(client.c:2715:ptlrpc_set_wait()) set 00000000fad32af9 going to sleep for 11 seconds 00000100:00100000:0.0:1788830433.125329:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595103360 00000100:00100000:0.0:1788830433.125350:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595103360 00000100:00100000:0.0:1788830433.125386:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788830433.125397:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000162e37eb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1745cc3d-3952-4cd4-9020-9b8acb483105+10:5813:x1875724595103360:12345-0@lo:101: 00010000:00010000:0.0:1788830433.125409:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788830433.125423:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000062ce55e7/0x575506951eea088e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x575506951eea0887 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830433.125461:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000062ce55e7/0x575506951eea088e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x575506951eea0887 expref: 11 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830433.125480:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000062ce55e7/0x575506951eea088e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x575506951eea0887 expref: 11 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830433.125498:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000062ce55e7, rc 0) 00000100:00100000:0.0:1788830433.125574:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000162e37eb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1745cc3d-3952-4cd4-9020-9b8acb483105+11:5813:x1875724595103360:12345-0@lo:101: Request processed in 177us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830433.125583:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788830433.125763:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000014e5812d pname:cluuid:pid:xid:nid:opc:job mount.lustre:1745cc3d-3952-4cd4-9020-9b8acb483105:5813:1875724595103360:0@lo:101: 00010000:00010000:1.0:1788830433.125930:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.121@tcp lock: 000000000d1128c3/0x575506951eea0887 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea088e expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830433.125945:0:5813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.121@tcp lock: 000000000d1128c3/0x575506951eea0887 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x575506951eea088e expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788830433.126043:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000014e5812d pname:cluuid:pid:xid:nid:opc:job mount.lustre:1745cc3d-3952-4cd4-9020-9b8acb483105:5813:1875724595103488:0@lo:501: 00000100:00100000:1.0:1788830433.126102:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830433.126188:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595103488 00000100:00100000:0.0:1788830433.126196:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595103488 00000100:00100000:0.0:1788830433.126234:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788830433.126245:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002443ac52 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1745cc3d-3952-4cd4-9020-9b8acb483105+11:5813:x1875724595103488:12345-0@lo:501: 00000100:00100000:0.0:1788830433.127411:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002443ac52 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1745cc3d-3952-4cd4-9020-9b8acb483105+11:5813:x1875724595103488:12345-0@lo:501: Request processed in 1167us (1307us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830433.127421:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788830433.127511:0:5813:0:(client.c:2715:ptlrpc_set_wait()) set 00000000fad32af9 going to sleep for 11 seconds 00000100:00100000:1.0:1788830433.127536:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000014e5812d pname:cluuid:pid:xid:nid:opc:job mount.lustre:1745cc3d-3952-4cd4-9020-9b8acb483105:5813:1875724595103488:0@lo:501: 00000100:00100000:1.0:1788830433.127582:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000014e5812d pname:cluuid:pid:xid:nid:opc:job mount.lustre:1745cc3d-3952-4cd4-9020-9b8acb483105:5813:1875724595103616:0@lo:503: 00000100:00100000:1.0:1788830433.127623:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830433.127649:0:5813:0:(client.c:2715:ptlrpc_set_wait()) set 00000000fad32af9 going to sleep for 11 seconds 00000100:00100000:0.0:1788830433.127935:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595103616 00000100:00100000:0.0:1788830433.127942:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595103616 00000100:00100000:0.0:1788830433.127969:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788830433.127975:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000045fe9b88 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1745cc3d-3952-4cd4-9020-9b8acb483105+11:5813:x1875724595103616:12345-0@lo:503: 00000040:00080000:0.0:1788830433.128013:0:5827:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788830433.128061:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000045fe9b88 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1745cc3d-3952-4cd4-9020-9b8acb483105+11:5813:x1875724595103616:12345-0@lo:503: Request processed in 87us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830433.128068:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788830433.128109:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000014e5812d pname:cluuid:pid:xid:nid:opc:job mount.lustre:1745cc3d-3952-4cd4-9020-9b8acb483105:5813:1875724595103616:0@lo:503: 00000040:00080000:1.0:1788830433.130696:0:5860:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:0.0:1788830433.131002:0:5813:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:0.0:1788830433.131019:0:5813:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788830433.131039:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: 000000000d1128c3/0x575506951eea0887 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea088e expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830433.131051:0:5813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.121@tcp lock: 000000000d1128c3/0x575506951eea0887 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea088e expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788830433.131095:0:5813:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788830433.131098:0:5813:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9e255d9b0800 10000000:01000000:0.0:1788830433.131101:0:5813:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9e255d9b0800 10000000:01000000:0.0:1788830433.131105:0:5813:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788830433.131111:0:5813:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9e255d9b0800 from 1 10000000:01000000:0.0:1788830433.131113:0:5813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788830433.131143:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.121@tcp lock: 00000000c144d254/0x575506951eea0895 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830433.131150:0:5813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.121@tcp lock: 00000000c144d254/0x575506951eea0895 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830433.131160:0:5813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.121@tcp lock: 00000000c144d254/0x575506951eea0895 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788830433.131182:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000091329f08 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1745cc3d-3952-4cd4-9020-9b8acb483105:5813:1875724595103744:0@lo:101: 00000100:00100000:0.0:1788830433.131247:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830433.131286:0:5813:0:(client.c:2715:ptlrpc_set_wait()) set 0000000010c5bf70 going to sleep for 11 seconds 00000100:00100000:0.0:1788830433.131317:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595103744 00000100:00100000:0.0:1788830433.131324:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595103744 00000100:00100000:0.0:1788830433.131362:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788830433.131370:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fb93302d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1745cc3d-3952-4cd4-9020-9b8acb483105+11:5813:x1875724595103744:12345-0@lo:101: 00010000:00010000:0.0:1788830433.131386:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788830433.131401:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000452b53bc/0x575506951eea089c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x575506951eea0895 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830433.131428:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000452b53bc/0x575506951eea089c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x575506951eea0895 expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830433.131438:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000452b53bc/0x575506951eea089c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x575506951eea0895 expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830433.131448:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000452b53bc, rc 0) 00000100:00100000:0.0:1788830433.131489:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fb93302d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1745cc3d-3952-4cd4-9020-9b8acb483105+12:5813:x1875724595103744:12345-0@lo:101: Request processed in 119us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830433.131496:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788830433.131550:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000091329f08 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1745cc3d-3952-4cd4-9020-9b8acb483105:5813:1875724595103744:0@lo:101: 00010000:00010000:0.0:1788830433.131564:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.121@tcp lock: 00000000c144d254/0x575506951eea0895 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea089c expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830433.131573:0:5813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.121@tcp lock: 00000000c144d254/0x575506951eea0895 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x575506951eea089c expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788830433.131617:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000091329f08 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1745cc3d-3952-4cd4-9020-9b8acb483105:5813:1875724595103872:0@lo:501: 00000100:00100000:0.0:1788830433.131642:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830433.131654:0:5813:0:(client.c:2715:ptlrpc_set_wait()) set 0000000010c5bf70 going to sleep for 11 seconds 00000100:00100000:0.0:1788830433.131665:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595103872 00000100:00100000:0.0:1788830433.131673:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595103872 00000100:00100000:0.0:1788830433.131690:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788830433.131695:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c81db300 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1745cc3d-3952-4cd4-9020-9b8acb483105+12:5813:x1875724595103872:12345-0@lo:501: 00000100:00100000:0.0:1788830433.132492:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c81db300 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1745cc3d-3952-4cd4-9020-9b8acb483105+12:5813:x1875724595103872:12345-0@lo:501: Request processed in 794us (847us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830433.132500:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788830433.134433:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000091329f08 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1745cc3d-3952-4cd4-9020-9b8acb483105:5813:1875724595103872:0@lo:501: 00000100:00100000:1.0:1788830433.134494:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008d618f1f pname:cluuid:pid:xid:nid:opc:job mount.lustre:1745cc3d-3952-4cd4-9020-9b8acb483105:5813:1875724595104000:0@lo:503: 00000100:00100000:1.0:1788830433.134564:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830433.134612:0:5813:0:(client.c:2715:ptlrpc_set_wait()) set 0000000086dc584e going to sleep for 11 seconds 00000100:00100000:2.0:1788830433.134668:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595104000 00000100:00100000:2.0:1788830433.134676:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595104000 00000100:00100000:2.0:1788830433.134747:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788830433.134755:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fefce1e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1745cc3d-3952-4cd4-9020-9b8acb483105+12:5813:x1875724595104000:12345-0@lo:503: 00000100:00100000:2.0:1788830433.135198:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fefce1e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1745cc3d-3952-4cd4-9020-9b8acb483105+12:5813:x1875724595104000:12345-0@lo:503: Request processed in 443us (633us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830433.135208:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788830433.135257:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008d618f1f pname:cluuid:pid:xid:nid:opc:job mount.lustre:1745cc3d-3952-4cd4-9020-9b8acb483105:5813:1875724595104000:0@lo:503: 00000100:00100000:1.0:1788830433.138546:0:5861:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000088e4f240 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1745cc3d-3952-4cd4-9020-9b8acb483105:5861:1875724595104128:0@lo:502: 00000100:00100000:1.0:1788830433.138641:0:5861:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830433.138688:0:5861:0:(client.c:2715:ptlrpc_set_wait()) set 0000000033966dbd going to sleep for 11 seconds 00000100:00100000:2.0:1788830433.138915:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595104128 00000100:00100000:2.0:1788830433.138923:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595104128 00000100:00100000:2.0:1788830433.138972:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788830433.138981:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b5dabc89 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1745cc3d-3952-4cd4-9020-9b8acb483105+12:5861:x1875724595104128:12345-0@lo:502: 00000100:00100000:2.0:1788830433.139456:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b5dabc89 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1745cc3d-3952-4cd4-9020-9b8acb483105+12:5861:x1875724595104128:12345-0@lo:502: Request processed in 475us (814us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830433.139464:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788830433.139563:0:5861:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000088e4f240 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1745cc3d-3952-4cd4-9020-9b8acb483105:5861:1875724595104128:0@lo:502: 00000020:01000004:0.0:1788830433.139638:0:5861:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1788830433.139655:0:5861:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000c42999d3) 00000020:00000080:0.0:1788830433.139673:0:5861:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:0.0:1788830433.139899:0:5861:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000dfbf402d from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788830433.139903:0:5861:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000dfbf402d from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788830433.139907:0:5861:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000dfbf402d 4 00010000:00080000:0.0:1788830433.139936:0:5861:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000adbf5c11@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.121@tcp at head 00010000:00010000:2.0:1788830433.142467:0:5861:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:2.0:1788830433.142680:0:5861:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1788830433.142756:0:5861:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788830433.142779:0:5861:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x575506951eea08aa 00000100:00080000:2.0:1788830433.142789:0:5861:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788830433.142794:0:5861:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000adbf5c11 using connection 192.168.201.121@tcp/0@lo 00000100:00100000:2.0:1788830433.142829:0:5861:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000068251d6b x1875724595104256/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788830433.142851:0:5861:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788830433.143241:0:5861:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000006b53dc4 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1745cc3d-3952-4cd4-9020-9b8acb483105:5861:1875724595104384:0@lo:502: 00000100:00100000:0.0:1788830433.143333:0:5861:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830433.143370:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595104384 00000100:00100000:0.0:1788830433.143378:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595104384 00000100:00100000:0.0:1788830433.143419:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788830433.143428:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000467af6ce pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+12:5861:x1875724595104384:12345-0@lo:502: 00000100:00100000:0.0:1788830433.143659:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000467af6ce pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+12:5861:x1875724595104384:12345-0@lo:502: Request processed in 231us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830433.143666:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788830433.143868:0:5861:0:(client.c:2715:ptlrpc_set_wait()) set 0000000010c5bf70 going to sleep for 11 seconds 00000100:00100000:0.0:1788830433.143901:0:5861:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000006b53dc4 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1745cc3d-3952-4cd4-9020-9b8acb483105:5861:1875724595104384:0@lo:502: 00000040:00080000:0.0:1788830433.143930:0:5861:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000100:00100000:3.0:1788830433.145650:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000068251d6b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875724595104256:0@lo:38: 00000100:00100000:3.0:1788830433.145737:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830433.145878:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595104256 00000100:00100000:3.0:1788830433.145898:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595104256 00000100:00100000:3.0:1788830433.145937:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788830433.145942:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a37b986b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3306:x1875724595104256:12345-0@lo:38: 00000100:00100000:3.0:1788830433.145997:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a37b986b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3306:x1875724595104256:12345-0@lo:38: Request processed in 53us (260us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788830433.146011:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788830433.146050:0:3306:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788830433.146058:0:3306:0:(import.c:65:import_set_state_nolock()) 00000000adbf5c11 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788830433.146062:0:3306:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788830433.146065:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000068251d6b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875724595104256:0@lo:38: 00000020:01000000:2.0:1788830433.146198:0:5813:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:2.0:1788830433.146238:0:5813:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.121@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788830433.146258:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: 00000000c144d254/0x575506951eea0895 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea089c expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830433.146269:0:5813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.121@tcp lock: 00000000c144d254/0x575506951eea0895 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea089c expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788830433.146314:0:5813:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788830433.146317:0:5813:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788830433.146318:0:5813:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788830433.146319:0:5813:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788830433.146330:0:5813:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788830433.146332:0:5813:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788830433.146333:0:5813:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788830433.146334:0:5813:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788830433.146335:0:5813:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788830433.146336:0:5813:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788830433.146338:0:5813:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788830433.146339:0:5813:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788830433.146342:0:5813:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:2.0:1788830433.146344:0:5813:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788830433.146345:0:5813:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788830433.146345:0:5813:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788830433.146346:0:5813:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788830433.146347:0:5813:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788830433.146348:0:5813:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788830433.146349:0:5813:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788830433.146350:0:5813:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788830433.146350:0:5813:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788830433.146351:0:5813:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788830433.146352:0:5813:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788830433.146353:0:5813:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788830433.146383:0:5813:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788830433.146395:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008a2cdad9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1745cc3d-3952-4cd4-9020-9b8acb483105:5813:1875724595104512:0@lo:253: 00000100:00100000:2.0:1788830433.146437:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788830433.146464:0:5813:0:(client.c:2715:ptlrpc_set_wait()) set 000000000ed85cf7 going to sleep for 11 seconds 00000100:00100000:2.0:1788830433.146481:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595104512 00000100:00100000:2.0:1788830433.146484:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595104512 00000100:00100000:2.0:1788830433.146522:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788830433.146529:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000ff46d0a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1745cc3d-3952-4cd4-9020-9b8acb483105+12:5813:x1875724595104512:12345-0@lo:253: 20000000:01000000:2.0:1788830433.146549:0:5827:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788830433.146563:0:5827:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788830433.212914:0:5827:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788830433.212936:0:5827:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1788830433.212959:0:5848:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788830433.212964:0:5848:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788830433.212995:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000ab0a9838/0x575506951eea08b1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830433.213015:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000005f611a07/0x575506951eea0880 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x575506951eea0879 expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830433.213023:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000ab0a9838/0x575506951eea08b1 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830433.213071:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000005f611a07/0x575506951eea0880 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x575506951eea0879 expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830433.213105:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000005f611a07/0x575506951eea0880 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x575506951eea0879 expref: 12 pid: 5826 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788830433.213119:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000045142ff1 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5848:1875724595104640:0@lo:104: 00000100:00100000:1.0:1788830433.213179:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830433.213234:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set 00000000109e8d7c going to sleep for 11 seconds 00000100:00100000:1.0:1788830433.213258:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595104640 00000100:00100000:1.0:1788830433.213266:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595104640 00000100:00100000:1.0:1788830433.213312:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788830433.213321:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d7730215 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1745cc3d-3952-4cd4-9020-9b8acb483105+3:5848:x1875724595104640:12345-0@lo:104: 00010000:00010000:1.0:1788830433.213332:0:5815:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.121@tcp lock: 000000001626f271/0x575506951eea0879 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x575506951eea0880 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830433.213393:0:5815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788830433.213398:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d7730215 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1745cc3d-3952-4cd4-9020-9b8acb483105+3:5848:x1875724595104640:12345-0@lo:104: Request processed in 79us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830433.213405:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788830433.213448:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000045142ff1 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5848:1875724595104640:0@lo:104: 00010000:00010000:0.0:1788830433.213479:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000ab0a9838/0x575506951eea08b1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830433.213532:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788830433.213538:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.121@tcp lock: 000000001626f271/0x575506951eea0879 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x575506951eea0880 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830433.213545:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000001626f271 already unused, calling callback (0000000018a9601d) 10000000:00010000:3.0:1788830433.213548:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.121@tcp lock: 000000001626f271/0x575506951eea0879 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x575506951eea0880 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830433.213556:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.121@tcp lock: 000000001626f271/0x575506951eea0879 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x575506951eea0880 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788830433.213572:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.121@tcp lock: 000000001626f271/0x575506951eea0879 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x575506951eea0880 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788830433.213576:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788830433.213613:0:5820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.121@tcp lock: 000000001626f271/0x575506951eea0879 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x575506951eea0880 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830433.213620:0:5820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788830433.213644:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.121@tcp lock: 000000001626f271/0x575506951eea0879 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x575506951eea0880 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830433.213650:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.121@tcp lock: 000000001626f271/0x575506951eea0879 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x575506951eea0880 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830433.213667:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788830433.213669:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788830433.213670:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788830433.213783:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788830433.213793:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008367cf6f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1745cc3d-3952-4cd4-9020-9b8acb483105:3307:1875724595104768:0@lo:103: 00000100:00100000:0.0:1788830433.213822:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830433.214139:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595104768 00000100:00100000:0.0:1788830433.214145:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595104768 00010000:00010000:0.0:1788830433.214164:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000005f611a07/0x575506951eea0880 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x575506951eea0879 expref: 13 pid: 5826 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788830433.214200:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788830433.214207:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000006b53dc4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1745cc3d-3952-4cd4-9020-9b8acb483105+13:3307:x1875724595104768:12345-0@lo:103: 00010000:00010000:0.0:1788830433.214217:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788830433.214221:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000005f611a07/0x575506951eea0880 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x575506951eea0879 expref: 13 pid: 5826 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830433.214231:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000005f611a07/0x575506951eea0880 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x575506951eea0879 expref: 13 pid: 5826 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830433.214243:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000005f611a07/0x575506951eea0880 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x575506951eea0879 expref: 13 pid: 5826 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830433.214256:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000ab0a9838/0x575506951eea08b1 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830433.214263:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ab0a9838/0x575506951eea08b1 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788830433.214275:0:5817:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001312076s 00010000:00010000:0.0:1788830433.214285:0:5817:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000ab0a9838/0x575506951eea08b1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830433.214291:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000ab0a9838/0x575506951eea08b1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830433.214297:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000ab0a9838/0x575506951eea08b1 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830433.214303:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000ab0a9838/0x575506951eea08b1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830433.214308:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000ab0a9838 already unused, calling callback (00000000df09f092) 00010000:00010000:0.0:1788830433.214311:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000ab0a9838/0x575506951eea08b1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830433.214318:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000ab0a9838/0x575506951eea08b1 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830433.214330:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000ab0a9838/0x575506951eea08b1 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830433.214340:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788830433.214371:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000006b53dc4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1745cc3d-3952-4cd4-9020-9b8acb483105+12:3307:x1875724595104768:12345-0@lo:103: Request processed in 165us (549us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830433.214378:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788830433.214406:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008367cf6f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1745cc3d-3952-4cd4-9020-9b8acb483105:3307:1875724595104768:0@lo:103: 00010000:00010000:0.0:1788830433.214424:0:5848:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000ab0a9838/0x575506951eea08b1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830433.214430:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000ab0a9838/0x575506951eea08b1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830433.214443:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000ab0a9838/0x575506951eea08b1 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788830433.238106:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000ff46d0a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1745cc3d-3952-4cd4-9020-9b8acb483105+11:5813:x1875724595104512:12345-0@lo:253: Request processed in 91570us (91661us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830433.238124:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788830433.238283:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008a2cdad9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1745cc3d-3952-4cd4-9020-9b8acb483105:5813:1875724595104512:0@lo:253: 10000000:01000000:2.0:1788830433.238299:0:5813:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788830433.238302:0:5813:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788830433.238305:0:5813:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788830433.238321:0:5813:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788830433.238322:0:5813:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788830433.238323:0:5813:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788830433.238324:0:5813:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788830433.238326:0:5813:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788830433.238327:0:5813:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788830433.238328:0:5813:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788830433.238330:0:5813:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788830433.238331:0:5813:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788830433.238333:0:5813:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788830433.238348:0:5813:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788830433.246262:0:5813:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1788830433.247207:0:5813:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788830433.247443:0:5813:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:2.0:1788830433.247647:0:5813:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1788830433.248370:0:5813:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:2.0:1788830433.248560:0:5813:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1788830433.249528:0:5813:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:2.0:1788830433.249987:0:5813:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1788830433.250272:0:5813:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1788830433.250454:0:5813:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1788830433.250882:0:5813:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1788830433.251148:0:5813:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:1.0:1788830433.301581:0:5813:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00010000:00010000:0.0:1788830433.308013:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1788830433.354676:0:5813:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:3.0:1788830433.355124:0:5867:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000020:00080000:2.0:1788830433.355903:0:5866:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:2.0:1788830433.355909:0:5866:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:0.0:1788830433.362328:0:5813:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1788830433.362528:0:5813:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1788830433.367610:0:5813:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1788830433.367695:0:5813:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1788830433.368181:0:5813:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788830433.369194:0:5813:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1788830433.369798:0:5813:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1788830433.369825:0:5813:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1788830433.370133:0:5813:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1788830433.370561:0:5813:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:0.0:1788830433.372576:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:0.0:1788830433.372819:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:0.0:1788830433.374151:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:0.0:1788830433.374369:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:0.0:1788830433.374570:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:0.0:1788830433.375131:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:0.0:1788830433.375386:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:0.0:1788830433.375524:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:0.0:1788830433.375657:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:0.0:1788830433.375834:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:0.0:1788830433.377233:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:0.0:1788830433.377397:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:0.0:1788830433.377558:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:0.0:1788830433.377822:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:0.0:1788830433.380564:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:0.0:1788830433.380993:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:0.0:1788830433.381415:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:0.0:1788830433.381658:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:0.0:1788830433.382213:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:0.0:1788830433.382433:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:0.0:1788830433.383652:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:0.0:1788830433.384029:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:0.0:1788830433.384222:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:0.0:1788830433.384435:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:0.0:1788830433.384592:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:0.0:1788830433.386879:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:1.0:1788830433.388278:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:0.0:1788830433.389587:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:0.0:1788830433.391856:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:0.0:1788830433.392154:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:0.0:1788830433.392289:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:0.0:1788830433.392439:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:0.0:1788830433.392655:0:5813:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:3.0:1788830433.407973:0:5867:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:1.0:1788830433.452140:0:5813:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1788830433.452177:0:5813:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb658c1ca3988 00100000:10000000:1.0:1788830433.452185:0:5813:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1788830433.454016:0:5813:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788830433.454031:0:5813:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.121@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788830433.454045:0:5813:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1788830433.454061:0:5813:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:0.0:1788830433.502876:0:5867:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788830433.502981:0:5867:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1788830433.502987:0:5867:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:3.0:1788830434.335059:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788830435.356568:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788830436.379897:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788830437.404804:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788830437.723123:0:6110:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg121-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788830438.428822:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788830438.623556:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788830438.623566:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788830438.623569:0:8:0:(import.c:65:import_set_state_nolock()) 00000000adbf5c11 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788830438.623581:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000adbf5c11 using connection 192.168.201.121@tcp/0@lo 00000100:00100000:3.0:1788830438.623603:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000d16cb713 x1875724595105024/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788830438.623703:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000014495a08 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1745cc3d-3952-4cd4-9020-9b8acb483105:3309:1875724595104896:0@lo:400: 00000100:00100000:3.0:1788830438.623789:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830438.623859:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d16cb713 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875724595105024:0@lo:38: 00000100:00100000:3.0:1788830438.623886:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830438.623922:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595104896 00000100:00100000:3.0:1788830438.623930:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595104896 00000100:00100000:3.0:1788830438.623970:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788830438.623978:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000baa62ee2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+11:3309:x1875724595104896:12345-0@lo:400: 00000100:00100000:3.0:1788830438.624023:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000baa62ee2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+11:3309:x1875724595104896:12345-0@lo:400: Request processed in 46us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830438.624030:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788830438.624062:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595105024 00000100:00100000:3.0:1788830438.624066:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595105024 00000100:00100000:3.0:1788830438.624084:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788830438.624088:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bbace9f6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3306:x1875724595105024:12345-0@lo:38: 00010000:00080000:3.0:1788830438.624107:0:5834:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 191 last 0 00000020:00000080:3.0:1788830438.624140:0:5834:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x575506951eea08b8 00000004:00100000:3.0:1788830438.624223:0:5834:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788830438.626469:0:5834:0:(import.c:65:import_set_state_nolock()) 00000000134a99d4 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788830438.626865:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bbace9f6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875724595105024:12345-0@lo:38: Request processed in 2770us (2973us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830438.626877:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788830438.627881:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000d16cb713 x1875724595105024/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788830448 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788830438.627907:0:3306:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1788830438.627926:0:3306:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1788830438.627931:0:3306:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788830438.627935:0:3306:0:(import.c:65:import_set_state_nolock()) 00000000adbf5c11 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788830438.627941:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d16cb713 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875724595105024:0@lo:38: 00000100:00100000:3.0:1788830438.628000:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000014495a08 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1745cc3d-3952-4cd4-9020-9b8acb483105:3309:1875724595104896:0@lo:400: 00010000:00010000:1.0:1788830439.453501:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788830440.479784:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788830441.516865:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788830441.691919:0:5829:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788830441.691927:0:5829:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9e255d9b0800 from 3 10000000:01000000:1.0:1788830441.691932:0:5829:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788830441.691985:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.121@tcp lock: 000000001bb67583/0x575506951eea08bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830441.691997:0:5829:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.121@tcp lock: 000000001bb67583/0x575506951eea08bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830441.692007:0:5829:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.121@tcp lock: 000000001bb67583/0x575506951eea08bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788830441.692030:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f07ea5fc pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1745cc3d-3952-4cd4-9020-9b8acb483105:5829:1875724595105152:0@lo:101: 00000100:00100000:1.0:1788830441.692109:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830441.692167:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set 00000000cfc009f8 going to sleep for 11 seconds 00000100:00100000:3.0:1788830441.692202:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595105152 00000100:00100000:3.0:1788830441.692212:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595105152 00000100:00100000:3.0:1788830441.692271:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788830441.692279:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000054cfb031 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1745cc3d-3952-4cd4-9020-9b8acb483105+11:5829:x1875724595105152:12345-0@lo:101: 00010000:00010000:3.0:1788830441.692293:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788830441.692306:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000fa387a6c/0x575506951eea08c6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x575506951eea08bf expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830441.692326:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000fa387a6c/0x575506951eea08c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x575506951eea08bf expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830441.692336:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000fa387a6c/0x575506951eea08c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x575506951eea08bf expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830441.692345:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000fa387a6c, rc 0) 00000100:00100000:3.0:1788830441.692380:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000054cfb031 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1745cc3d-3952-4cd4-9020-9b8acb483105+12:5829:x1875724595105152:12345-0@lo:101: Request processed in 102us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830441.692387:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788830441.692554:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f07ea5fc pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1745cc3d-3952-4cd4-9020-9b8acb483105:5829:1875724595105152:0@lo:101: 00010000:00010000:1.0:1788830441.692580:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.121@tcp lock: 000000001bb67583/0x575506951eea08bf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea08c6 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830441.692660:0:5829:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.121@tcp lock: 000000001bb67583/0x575506951eea08bf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x575506951eea08c6 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788830441.694933:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f07ea5fc pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1745cc3d-3952-4cd4-9020-9b8acb483105:5829:1875724595105280:0@lo:256: 00000100:00100000:1.0:1788830441.695002:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830441.695049:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set 00000000cfc009f8 going to sleep for 11 seconds 00000100:00100000:2.0:1788830441.695163:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595105280 00000100:00100000:2.0:1788830441.695171:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595105280 00000100:00100000:2.0:1788830441.695223:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788830441.695233:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d7e64004 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1745cc3d-3952-4cd4-9020-9b8acb483105+12:5829:x1875724595105280:12345-0@lo:256: 20000000:01000000:2.0:1788830441.695256:0:5826:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788830441.695277:0:5826:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788830441.695280:0:5826:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:2.0:1788830441.695355:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d7e64004 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1745cc3d-3952-4cd4-9020-9b8acb483105+12:5829:x1875724595105280:12345-0@lo:256: Request processed in 124us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830441.695364:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788830441.695444:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f07ea5fc pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1745cc3d-3952-4cd4-9020-9b8acb483105:5829:1875724595105280:0@lo:256: 10000000:01000000:1.0:1788830441.695493:0:5829:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.121@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788830441.695500:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: 000000001bb67583/0x575506951eea08bf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea08c6 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830441.695510:0:5829:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.121@tcp lock: 000000001bb67583/0x575506951eea08bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea08c6 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1788830441.922617:0:6312:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdb98491a0 20000000:00000080:0.0:1788830441.922638:0:6312:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9e257f0d0c00 uarg=0000000000000000 20000000:01000000:0.0:1788830441.922673:0:6312:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1788830441.922679:0:6312:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1788830441.922684:0:6312:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1788830441.923100:0:6312:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:0.0:1788830441.923114:0:6312:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:1.0:1788830441.929488:0:6312:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788830441.929961:0:6312:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1788830441.930026:0:6312:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:1.0:1788830441.930072:0:6312:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:1.0:1788830441.930089:0:6312:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788830441.930106:0:6312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000005c92837c/0x575506951eea08cd lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830441.930128:0:6312:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000062ce55e7/0x575506951eea088e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x575506951eea0887 expref: 11 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830441.930137:0:6312:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000005c92837c/0x575506951eea08cd lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830441.930179:0:6312:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000062ce55e7/0x575506951eea088e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x575506951eea0887 expref: 11 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830441.930199:0:6312:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000062ce55e7/0x575506951eea088e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x575506951eea0887 expref: 11 pid: 5827 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788830441.930217:0:6312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f07ea5fc pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6312:1875724595105408:0@lo:104: 00000100:00100000:1.0:1788830441.930291:0:6312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830441.930394:0:6312:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b07c6b63 going to sleep for 11 seconds 00000100:00100000:2.0:1788830441.930441:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595105408 00000100:00100000:2.0:1788830441.930448:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595105408 00000100:00100000:2.0:1788830441.930533:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788830441.930542:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000032e71f91 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1745cc3d-3952-4cd4-9020-9b8acb483105+3:6312:x1875724595105408:12345-0@lo:104: 00010000:00010000:2.0:1788830441.930554:0:5815:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.121@tcp lock: 000000000d1128c3/0x575506951eea0887 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x575506951eea088e expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830441.930622:0:5815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788830441.930628:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000032e71f91 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1745cc3d-3952-4cd4-9020-9b8acb483105+3:6312:x1875724595105408:12345-0@lo:104: Request processed in 88us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830441.930635:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1788830441.930679:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788830441.930685:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.121@tcp lock: 000000000d1128c3/0x575506951eea0887 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x575506951eea088e expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830441.930748:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000000d1128c3 already unused, calling callback (0000000018a9601d) 10000000:00010000:3.0:1788830441.930751:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.121@tcp lock: 000000000d1128c3/0x575506951eea0887 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x575506951eea088e expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830441.930757:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.121@tcp lock: 000000000d1128c3/0x575506951eea0887 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x575506951eea088e expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788830441.930763:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.121@tcp lock: 000000000d1128c3/0x575506951eea0887 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x575506951eea088e expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788830441.930769:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788830441.930800:0:5820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.121@tcp lock: 000000000d1128c3/0x575506951eea0887 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x575506951eea088e expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830441.930807:0:5820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788830441.930822:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.121@tcp lock: 000000000d1128c3/0x575506951eea0887 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x575506951eea088e expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830441.930829:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.121@tcp lock: 000000000d1128c3/0x575506951eea0887 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x575506951eea088e expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830441.930844:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788830441.930845:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788830441.930847:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788830441.930865:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788830441.930876:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000014495a08 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1745cc3d-3952-4cd4-9020-9b8acb483105:3309:1875724595105536:0@lo:103: 00000100:00100000:3.0:1788830441.930906:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830441.931014:0:6312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f07ea5fc pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6312:1875724595105408:0@lo:104: 00010000:00010000:1.0:1788830441.931034:0:6312:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000005c92837c/0x575506951eea08cd lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788830441.935124:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595105536 00000100:00100000:0.0:1788830441.935141:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595105536 00010000:00010000:0.0:1788830441.935188:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000062ce55e7/0x575506951eea088e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x575506951eea0887 expref: 12 pid: 5827 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788830441.935244:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788830441.935252:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d16cb713 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1745cc3d-3952-4cd4-9020-9b8acb483105+12:3309:x1875724595105536:12345-0@lo:103: 00010000:00010000:0.0:1788830441.935267:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788830441.935271:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000062ce55e7/0x575506951eea088e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x575506951eea0887 expref: 12 pid: 5827 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830441.935283:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000062ce55e7/0x575506951eea088e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x575506951eea0887 expref: 12 pid: 5827 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830441.935299:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000062ce55e7/0x575506951eea088e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x575506951eea0887 expref: 12 pid: 5827 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830441.935317:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000005c92837c/0x575506951eea08cd lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830441.935342:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005c92837c/0x575506951eea08cd lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830441.935358:0:5817:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000005c92837c/0x575506951eea08cd lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830441.935364:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000005c92837c/0x575506951eea08cd lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830441.935369:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000005c92837c/0x575506951eea08cd lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830441.935375:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000005c92837c/0x575506951eea08cd lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830441.935380:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000005c92837c already unused, calling callback (00000000df09f092) 00010000:00010000:0.0:1788830441.935383:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000005c92837c/0x575506951eea08cd lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830441.935390:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000005c92837c/0x575506951eea08cd lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830441.935405:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000005c92837c/0x575506951eea08cd lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830441.935415:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788830441.935485:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d16cb713 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1745cc3d-3952-4cd4-9020-9b8acb483105+11:3309:x1875724595105536:12345-0@lo:103: Request processed in 234us (4578us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830441.935492:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788830441.935539:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000014495a08 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1745cc3d-3952-4cd4-9020-9b8acb483105:3309:1875724595105536:0@lo:103: 00010000:00010000:0.0:1788830441.935589:0:6312:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000005c92837c/0x575506951eea08cd lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830441.935596:0:6312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000005c92837c/0x575506951eea08cd lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830441.935601:0:6312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000005c92837c/0x575506951eea08cd lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830442.523939:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788830443.547788:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788830443.740328:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f07ea5fc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1745cc3d-3952-4cd4-9020-9b8acb483105:3307:1875724595105664:0@lo:400: 00000100:00100000:1.0:1788830443.740401:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830443.740462:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788830443.740468:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bc9dad32 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875724595105792:0@lo:400: 00000100:00100000:1.0:1788830443.740498:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830443.743871:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595105664 00000100:00100000:3.0:1788830443.743895:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595105664 00000100:00100000:3.0:1788830443.743951:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788830443.743960:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001f17e2c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1745cc3d-3952-4cd4-9020-9b8acb483105+11:3307:x1875724595105664:12345-0@lo:400: 00000100:00100000:3.0:1788830443.744055:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001f17e2c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1745cc3d-3952-4cd4-9020-9b8acb483105+11:3307:x1875724595105664:12345-0@lo:400: Request processed in 97us (3654us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830443.744063:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788830443.744100:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595105792 00000100:00100000:3.0:1788830443.744104:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595105792 00000100:00100000:3.0:1788830443.744130:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788830443.744136:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002c1200f8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875724595105792:12345-0@lo:400: 00000100:00100000:3.0:1788830443.744168:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002c1200f8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875724595105792:12345-0@lo:400: Request processed in 32us (3670us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830443.744174:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788830443.744222:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000bc9dad32 x1875724595105792/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788830459 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788830443.744238:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bc9dad32 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875724595105792:0@lo:400: 00000100:00100000:3.0:1788830443.744251:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f07ea5fc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1745cc3d-3952-4cd4-9020-9b8acb483105:3307:1875724595105664:0@lo:400: 00010000:00010000:0.0:1788830444.572142:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788830445.595912:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788830446.620299:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788830447.482388:0:6675:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788830447.482393:0:6675:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:1.0:1788830447.482665:0:6675:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000d317ade2 00000020:01000004:1.0:1788830447.482682:0:6675:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1788830447.482694:0:6675:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1788830447.482738:0:6675:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (000000007b9b84bc) 00000020:00000080:1.0:1788830447.482755:0:6675:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1788830447.500769:0:6675:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:0.0:1788830447.501103:0:6675:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1788830447.526393:0:6675:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1788830447.532235:0:6675:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788830447.532273:0:6675:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1788830447.532328:0:6675:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788830447.532366:0:6675:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1788830447.532803:0:6675:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1788830447.532813:0:6675:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788830447.532828:0:6675:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x575506951eea08db 00000020:01000004:3.0:1788830447.532837:0:6675:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1788830447.532857:0:6675:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.121@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788830447.532860:0:6675:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.121@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788830447.532865:0:6675:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1788830447.532870:0:6675:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1788830447.532879:0:6675:0:(genops.c:413:class_newdev()) Allocate new device OSS (00000000bbaff8f4) 00000020:00000080:3.0:1788830447.532889:0:6675:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:3.0:1788830447.537506:0:6675:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788830447.538399:0:6675:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1788830447.538417:0:6675:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1788830447.540322:0:6675:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1788830447.540336:0:6675:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1788830447.544877:0:6675:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1788830447.544894:0:6675:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1788830447.550875:0:6675:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788830447.552955:0:6675:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1788830447.552964:0:6675:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1788830447.565050:0:6675:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1788830447.565073:0:6675:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1788830447.613614:0:6675:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788830447.613887:0:6675:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788830447.613905:0:6675:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1788830447.615544:0:6675:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788830447.615557:0:6675:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1788830447.622879:0:6675:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788830447.622903:0:6675:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1788830447.626387:0:6675:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788830447.626588:0:6675:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1788830447.626593:0:6675:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1788830447.634520:0:6675:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1788830447.634533:0:6675:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00010000:00010000:3.0:1788830447.644808:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788830447.702070:0:6675:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788830447.702350:0:6675:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1788830447.702356:0:6675:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1788830447.704480:0:6675:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1788830447.704495:0:6675:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1788830447.705310:0:6675:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1788830447.705337:0:6675:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1788830447.705349:0:6675:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.121@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1788830447.739238:0:6675:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.121@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788830447.739285:0:6675:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.121@tcp, index=0000, flags=0x20062 00000020:01000004:3.0:1788830447.739290:0:6675:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788830447.739291:0:6675:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788830447.739293:0:6675:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788830447.739294:0:6675:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788830447.739295:0:6675:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788830447.739297:0:6675:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788830447.739298:0:6675:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788830447.739300:0:6675:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788830447.739307:0:6675:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788830447.739309:0:6675:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788830447.739310:0:6675:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788830447.739314:0:6675:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:3.0:1788830447.739316:0:6675:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788830447.739318:0:6675:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788830447.739319:0:6675:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788830447.739320:0:6675:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788830447.739321:0:6675:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788830447.739322:0:6675:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788830447.739323:0:6675:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788830447.739324:0:6675:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788830447.739325:0:6675:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788830447.739326:0:6675:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788830447.739326:0:6675:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788830447.739355:0:6675:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788830447.739372:0:6675:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009b4df39d pname:cluuid:pid:xid:nid:opc:job mount.lustre:1745cc3d-3952-4cd4-9020-9b8acb483105:6675:1875724595105920:0@lo:253: 00000100:00100000:3.0:1788830447.740287:0:6675:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830447.740393:0:6675:0:(client.c:2715:ptlrpc_set_wait()) set 00000000bc787b08 going to sleep for 11 seconds 00000100:00100000:2.0:1788830447.743780:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595105920 00000100:00100000:2.0:1788830447.743795:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595105920 00000100:00100000:3.0:1788830447.743985:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788830447.743995:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c8b2d3d0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+11:6675:x1875724595105920:12345-0@lo:253: 20000000:01000000:3.0:1788830447.744058:0:5824:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1788830447.744062:0:5824:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:3.0:1788830447.744067:0:5824:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:3.0:1788830447.744070:0:5824:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:3.0:1788830447.745311:0:5824:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788830447.745535:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:3.0:1788830447.745549:0:5824:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:3.0:1788830447.746116:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:3.0:1788830447.746126:0:5824:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:3.0:1788830447.746162:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:3.0:1788830447.746213:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:3.0:1788830447.746594:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:3.0:1788830447.746613:0:5824:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.121@tcp 20000000:01000000:3.0:1788830447.746615:0:5824:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.121@tcp (null) (null) (null) 00000040:00080000:3.0:1788830447.746682:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:3.0:1788830447.746690:0:5824:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1788830447.746758:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:3.0:1788830447.746779:0:5824:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.201.121@tcp (null) (null) 00000040:00080000:3.0:1788830447.746813:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:3.0:1788830447.746822:0:5824:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1788830447.746852:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:3.0:1788830447.746901:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:3.0:1788830447.747604:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:3.0:1788830447.747618:0:5824:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.121@tcp 20000000:01000000:3.0:1788830447.747620:0:5824:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.121@tcp (null) (null) (null) 00000040:00080000:2.0:1788830447.748183:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:2.0:1788830447.748195:0:5824:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1788830447.748234:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:2.0:1788830447.748243:0:5824:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.201.121@tcp (null) (null) 00000040:00080000:2.0:1788830447.748294:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:2.0:1788830447.748304:0:5824:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1788830447.748336:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:2.0:1788830447.748373:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:2.0:1788830447.748391:0:5824:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:2.0:1788830447.748394:0:5824:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:2.0:1788830447.748400:0:5824:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1788830447.748402:0:5824:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1788830447.748404:0:5824:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1788830447.748416:0:5824:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1788830447.748419:0:5824:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1788830447.748453:0:5824:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1788830447.748455:0:5824:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788830447.749140:0:6690:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 8 1->4: lustre sys.timeout 20000000:01000000:2.0:1788830447.749187:0:6690:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 8 2->4: lustre sys.timeout 00000040:00080000:2.0:1788830447.749244:0:6690:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:3.0:1788830447.752315:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:3.0:1788830447.752361:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:3.0:1788830447.752422:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:3.0:1788830447.752435:0:5824:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1788830447.752437:0:5824:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788830447.753240:0:6691:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:3.0:1788830447.753292:0:6691:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:3.0:1788830447.753335:0:6691:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:2.0:1788830447.753978:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:2.0:1788830447.754015:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:2.0:1788830447.754050:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:2.0:1788830447.754063:0:5824:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1788830447.754065:0:5824:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1788830447.767290:0:6692:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:3.0:1788830447.767802:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:3.0:1788830447.767846:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:3.0:1788830447.767936:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 10000000:01000000:3.0:1788830447.767956:0:5824:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788830447.767974:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000008f1b9454/0x575506951eea08e9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830447.767993:0:5824:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000c9fe41fa/0x575506951eea0810 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x575506951eea0809 expref: 11 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830447.767999:0:5824:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000ab0bf965/0x575506951eea082c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x575506951eea0825 expref: 11 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830447.768017:0:5824:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000452b53bc/0x575506951eea089c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x575506951eea0895 expref: 11 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830447.768023:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000008f1b9454/0x575506951eea08e9 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830447.768061:0:5824:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000452b53bc/0x575506951eea089c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x575506951eea0895 expref: 11 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830447.768074:0:5824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000452b53bc/0x575506951eea089c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x575506951eea0895 expref: 11 pid: 5827 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788830447.768087:0:5824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000034d625f6 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5824:1875724595106048:0@lo:104: 00000100:00100000:3.0:1788830447.768154:0:5824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788830447.768201:0:5824:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000ab0bf965/0x575506951eea082c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x575506951eea0825 expref: 11 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830447.768209:0:5824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000ab0bf965/0x575506951eea082c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x575506951eea0825 expref: 11 pid: 5827 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788830447.768216:0:5824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b06174df pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5824:1875724595106176:0@lo:104: 00000100:00100000:3.0:1788830447.768238:0:5824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788830447.768271:0:5824:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000c9fe41fa/0x575506951eea0810 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x575506951eea0809 expref: 11 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830447.768278:0:5824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000c9fe41fa/0x575506951eea0810 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x575506951eea0809 expref: 11 pid: 5826 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788830447.768285:0:5824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000385ef33e pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5824:1875724595106304:0@lo:104: 00000100:00100000:3.0:1788830447.768312:0:5824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830447.768322:0:5824:0:(client.c:2715:ptlrpc_set_wait()) set 000000006b6d30f6 going to sleep for 11 seconds 00000100:00100000:1.0:1788830447.768402:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595106048 00000100:00100000:1.0:1788830447.768411:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595106048 00000100:00100000:1.0:1788830447.768445:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595106176 00000100:00100000:1.0:1788830447.768460:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595106176 00000100:00100000:1.0:1788830447.768472:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595106304 00000100:00100000:1.0:1788830447.768474:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595106304 00000100:00100000:1.0:1788830447.768488:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788830447.768495:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000aac4bfa0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1745cc3d-3952-4cd4-9020-9b8acb483105+5:5824:x1875724595106048:12345-0@lo:104: 00010000:00010000:1.0:1788830447.768506:0:5815:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.121@tcp lock: 00000000c144d254/0x575506951eea0895 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x575506951eea089c expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830447.768572:0:5815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788830447.768577:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000aac4bfa0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1745cc3d-3952-4cd4-9020-9b8acb483105+5:5824:x1875724595106048:12345-0@lo:104: Request processed in 83us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830447.768585:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788830447.768601:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788830447.768606:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000abc5f245 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1745cc3d-3952-4cd4-9020-9b8acb483105+4:5824:x1875724595106176:12345-0@lo:104: 00010000:00010000:1.0:1788830447.768612:0:5815:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.121@tcp lock: 00000000dc17adae/0x575506951eea0825 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x575506951eea082c expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830447.768665:0:5815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788830447.768670:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000abc5f245 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1745cc3d-3952-4cd4-9020-9b8acb483105+4:5824:x1875724595106176:12345-0@lo:104: Request processed in 64us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830447.768676:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788830447.768691:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788830447.768696:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f9f7dcef pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1745cc3d-3952-4cd4-9020-9b8acb483105+3:5824:x1875724595106304:12345-0@lo:104: 00010000:00010000:1.0:1788830447.768703:0:5815:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.121@tcp lock: 000000005cd528ab/0x575506951eea0809 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x575506951eea0810 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830447.768757:0:5815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788830447.768762:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f9f7dcef pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1745cc3d-3952-4cd4-9020-9b8acb483105+3:5824:x1875724595106304:12345-0@lo:104: Request processed in 66us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830447.768767:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1788830447.768784:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788830447.768789:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.121@tcp lock: 00000000c144d254/0x575506951eea0895 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x575506951eea089c expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830447.768795:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c144d254 already unused, calling callback (0000000018a9601d) 10000000:00010000:1.0:1788830447.768798:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.121@tcp lock: 00000000c144d254/0x575506951eea0895 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x575506951eea089c expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830447.768805:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.121@tcp lock: 00000000c144d254/0x575506951eea0895 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x575506951eea089c expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788830447.768811:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.121@tcp lock: 00000000c144d254/0x575506951eea0895 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x575506951eea089c expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788830447.768816:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788830447.768850:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.121@tcp lock: 00000000c144d254/0x575506951eea0895 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x575506951eea089c expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830447.768857:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788830447.768874:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.121@tcp lock: 00000000c144d254/0x575506951eea0895 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x575506951eea089c expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830447.768880:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.121@tcp lock: 00000000c144d254/0x575506951eea0895 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x575506951eea089c expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830447.768894:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788830447.768897:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.121@tcp lock: 00000000dc17adae/0x575506951eea0825 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x575506951eea082c expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830447.768902:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000dc17adae already unused, calling callback (0000000018a9601d) 10000000:00010000:1.0:1788830447.768903:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.121@tcp lock: 00000000dc17adae/0x575506951eea0825 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x575506951eea082c expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830447.768908:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.121@tcp lock: 00000000dc17adae/0x575506951eea0825 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x575506951eea082c expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788830447.768913:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.121@tcp lock: 00000000dc17adae/0x575506951eea0825 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x575506951eea082c expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788830447.768917:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788830447.768926:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.121@tcp lock: 00000000dc17adae/0x575506951eea0825 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x575506951eea082c expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830447.768931:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788830447.768935:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.121@tcp lock: 00000000dc17adae/0x575506951eea0825 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x575506951eea082c expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830447.768949:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.121@tcp lock: 00000000dc17adae/0x575506951eea0825 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x575506951eea082c expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830447.768958:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788830447.768960:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.121@tcp lock: 000000005cd528ab/0x575506951eea0809 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x575506951eea0810 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830447.768965:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000005cd528ab already unused, calling callback (0000000018a9601d) 10000000:00010000:1.0:1788830447.768967:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.121@tcp lock: 000000005cd528ab/0x575506951eea0809 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x575506951eea0810 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830447.768972:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.121@tcp lock: 000000005cd528ab/0x575506951eea0809 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x575506951eea0810 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788830447.768977:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.121@tcp lock: 000000005cd528ab/0x575506951eea0809 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x575506951eea0810 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788830447.768981:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788830447.768993:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.121@tcp lock: 000000005cd528ab/0x575506951eea0809 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x575506951eea0810 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830447.768998:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788830447.769012:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.121@tcp lock: 000000005cd528ab/0x575506951eea0809 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x575506951eea0810 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830447.769018:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.121@tcp lock: 000000005cd528ab/0x575506951eea0809 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x575506951eea0810 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830447.769030:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788830447.769036:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788830447.769038:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788830447.769044:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788830447.769053:0:5829:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788830447.769056:0:5829:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9e255d9b0800 from 21 10000000:01000000:1.0:1788830447.769060:0:5829:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788830447.769076:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.121@tcp lock: 000000007ff192a2/0x575506951eea08f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830447.769083:0:5829:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.121@tcp lock: 000000007ff192a2/0x575506951eea08f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830447.769091:0:5829:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.121@tcp lock: 000000007ff192a2/0x575506951eea08f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788830447.769104:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002ff5f425 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1745cc3d-3952-4cd4-9020-9b8acb483105:5829:1875724595106816:0@lo:101: 00000100:00100000:1.0:1788830447.769135:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830447.769160:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set 0000000053592d9a going to sleep for 11 seconds 00000100:00100000:1.0:1788830447.769174:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000640c957c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1745cc3d-3952-4cd4-9020-9b8acb483105:3309:1875724595106432:0@lo:103: 00000100:00100000:1.0:1788830447.769196:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830447.769215:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788830447.769219:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f5446d7d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1745cc3d-3952-4cd4-9020-9b8acb483105:3309:1875724595106560:0@lo:103: 00000100:00100000:1.0:1788830447.769237:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830447.769264:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000da84aedf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1745cc3d-3952-4cd4-9020-9b8acb483105:3307:1875724595106688:0@lo:103: 00000100:00100000:1.0:1788830447.769282:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830447.769311:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595106816 00000100:00100000:1.0:1788830447.769315:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595106816 00000100:00100000:1.0:1788830447.769340:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788830447.769347:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d7031660 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1745cc3d-3952-4cd4-9020-9b8acb483105+12:5829:x1875724595106816:12345-0@lo:101: 00010000:00010000:1.0:1788830447.769366:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788830447.769377:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000d1128c3/0x575506951eea08f7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x575506951eea08f0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830447.769392:0:5826:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000008f1b9454/0x575506951eea08e9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830447.769400:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000000d1128c3/0x575506951eea08f7 lrc: 4/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x575506951eea08f0 expref: 13 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830447.769410:0:5826:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: MGS lock: 000000008f1b9454/0x575506951eea08e9 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830447.769420:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000d1128c3/0x575506951eea08f7 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x575506951eea08f0 expref: 13 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830447.769427:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000d1128c3, rc 0) 00000100:00100000:1.0:1788830447.769455:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d7031660 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1745cc3d-3952-4cd4-9020-9b8acb483105+13:5829:x1875724595106816:12345-0@lo:101: Request processed in 110us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830447.769460:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788830447.769485:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595106432 00000100:00100000:1.0:1788830447.769489:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595106432 00010000:00010000:1.0:1788830447.769503:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000452b53bc/0x575506951eea089c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x575506951eea0895 expref: 13 pid: 5827 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788830447.769516:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595106560 00000100:00100000:1.0:1788830447.769519:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595106560 00010000:00010000:1.0:1788830447.769527:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000ab0bf965/0x575506951eea082c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x575506951eea0825 expref: 14 pid: 5827 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788830447.769535:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595106688 00000100:00100000:1.0:1788830447.769544:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595106688 00010000:00010000:1.0:1788830447.769555:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000c9fe41fa/0x575506951eea0810 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x575506951eea0809 expref: 15 pid: 5826 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788830447.769567:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788830447.769572:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000029d31dd4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1745cc3d-3952-4cd4-9020-9b8acb483105+15:3309:x1875724595106432:12345-0@lo:103: 00010000:00010000:1.0:1788830447.769579:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788830447.769583:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000452b53bc/0x575506951eea089c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x575506951eea0895 expref: 15 pid: 5827 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830447.769591:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000452b53bc/0x575506951eea089c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x575506951eea0895 expref: 15 pid: 5827 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830447.769602:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788830447.769628:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000029d31dd4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1745cc3d-3952-4cd4-9020-9b8acb483105+15:3309:x1875724595106432:12345-0@lo:103: Request processed in 56us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830447.769633:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788830447.769658:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788830447.769664:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d3b3f31e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1745cc3d-3952-4cd4-9020-9b8acb483105+14:3309:x1875724595106560:12345-0@lo:103: 00010000:00010000:1.0:1788830447.769671:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788830447.769674:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000ab0bf965/0x575506951eea082c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x575506951eea0825 expref: 14 pid: 5827 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830447.769682:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000ab0bf965/0x575506951eea082c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x575506951eea0825 expref: 14 pid: 5827 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830447.769691:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788830447.769736:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d3b3f31e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1745cc3d-3952-4cd4-9020-9b8acb483105+14:3309:x1875724595106560:12345-0@lo:103: Request processed in 72us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830447.769742:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788830447.769759:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788830447.769763:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fc93280f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1745cc3d-3952-4cd4-9020-9b8acb483105+13:3307:x1875724595106688:12345-0@lo:103: 00010000:00010000:1.0:1788830447.769770:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788830447.769773:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000c9fe41fa/0x575506951eea0810 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x575506951eea0809 expref: 13 pid: 5826 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830447.769780:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000c9fe41fa/0x575506951eea0810 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x575506951eea0809 expref: 13 pid: 5826 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830447.769790:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000008f1b9454/0x575506951eea08e9 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40290400000020 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830447.769796:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008f1b9454/0x575506951eea08e9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40290400000020 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830447.769807:0:5819:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000008f1b9454/0x575506951eea08e9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830447.769813:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000008f1b9454/0x575506951eea08e9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210400000020 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830447.769818:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000008f1b9454/0x575506951eea08e9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210400000020 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830447.769823:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000008f1b9454/0x575506951eea08e9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830447.769828:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000008f1b9454 already unused, calling callback (00000000df09f092) 00010000:00010000:1.0:1788830447.769830:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000008f1b9454/0x575506951eea08e9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830447.769836:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000008f1b9454/0x575506951eea08e9 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40218400000020 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830447.769851:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000000d1128c3/0x575506951eea08f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40080000000000 nid: 0@lo remote: 0x575506951eea08f0 expref: 13 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830447.769857:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000d1128c3/0x575506951eea08f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40080000000000 nid: 0@lo remote: 0x575506951eea08f0 expref: 13 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830447.769874:0:5819:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: MGS lock: 000000000d1128c3/0x575506951eea08f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x575506951eea08f0 expref: 13 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788830447.769883:0:5819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fd78c6fb pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:MGS:5819:1875724595106944:0@lo:105: 00000100:00100000:1.0:1788830447.769906:0:5819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830447.769921:0:5819:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ed0845e4 going to sleep for 11 seconds 00000100:00100000:1.0:1788830447.769956:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f5446d7d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1745cc3d-3952-4cd4-9020-9b8acb483105:3309:1875724595106560:0@lo:103: 00000100:00100000:1.0:1788830447.769963:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000640c957c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1745cc3d-3952-4cd4-9020-9b8acb483105:3309:1875724595106432:0@lo:103: 00000100:00100000:1.0:1788830447.769996:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002ff5f425 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1745cc3d-3952-4cd4-9020-9b8acb483105:5829:1875724595106816:0@lo:101: 00010000:00010000:1.0:1788830447.770004:0:5829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGC192.168.201.121@tcp lock: 000000007ff192a2/0x575506951eea08f0 lrc: 4/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea08f7 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830447.770011:0:5829:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGC192.168.201.121@tcp lock: 000000007ff192a2/0x575506951eea08f0 lrc: 4/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x575506951eea08f7 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788830447.770027:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595106944 00000100:00100000:1.0:1788830447.770030:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595106944 00000100:00100000:1.0:1788830447.770046:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788830447.770050:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f07ea5fc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1745cc3d-3952-4cd4-9020-9b8acb483105+3:5819:x1875724595106944:12345-0@lo:105: 00010000:00010000:1.0:1788830447.770055:0:5815:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: MGC192.168.201.121@tcp lock: 000000007ff192a2/0x575506951eea08f0 lrc: 5/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x575506951eea08f7 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830447.770068:0:5815:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: MGC192.168.201.121@tcp lock: 000000007ff192a2/0x575506951eea08f0 lrc: 5/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x575506951eea08f7 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830447.770075:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGC192.168.201.121@tcp lock: 000000007ff192a2/0x575506951eea08f0 lrc: 5/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11080000000000 nid: local remote: 0x575506951eea08f7 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830447.770080:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.121@tcp lock: 000000007ff192a2/0x575506951eea08f0 lrc: 6/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11080000000000 nid: local remote: 0x575506951eea08f7 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830447.770085:0:5815:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: MGC192.168.201.121@tcp lock: 000000007ff192a2/0x575506951eea08f0 lrc: 6/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1080000000000 nid: local remote: 0x575506951eea08f7 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830447.770098:0:5815:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock 000000007ff192a2) 00000100:00100000:1.0:1788830447.770142:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f07ea5fc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1745cc3d-3952-4cd4-9020-9b8acb483105+3:5819:x1875724595106944:12345-0@lo:105: Request processed in 91us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830447.770148:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:1.0:1788830447.770163:0:5829:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: MGC192.168.201.121@tcp lock: 000000007ff192a2/0x575506951eea08f0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x575506951eea08f7 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830447.770171:0:5829:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.121@tcp lock: 000000007ff192a2/0x575506951eea08f0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x575506951eea08f7 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788830447.770219:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002ff5f425 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1745cc3d-3952-4cd4-9020-9b8acb483105:5829:1875724595107072:0@lo:501: 00000100:00100000:1.0:1788830447.770244:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830447.770256:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set 0000000053592d9a going to sleep for 11 seconds 00000100:00100000:1.0:1788830447.770266:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595107072 00000100:00100000:1.0:1788830447.770269:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595107072 00000100:00100000:1.0:1788830447.770285:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788830447.770296:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004f5aef45 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1745cc3d-3952-4cd4-9020-9b8acb483105+14:5829:x1875724595107072:12345-0@lo:501: 00000100:00100000:1.0:1788830447.770390:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004f5aef45 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1745cc3d-3952-4cd4-9020-9b8acb483105+14:5829:x1875724595107072:12345-0@lo:501: Request processed in 95us (146us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830447.770397:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788830447.770424:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002ff5f425 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1745cc3d-3952-4cd4-9020-9b8acb483105:5829:1875724595107072:0@lo:501: 00000100:00100000:1.0:1788830447.770456:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002ff5f425 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1745cc3d-3952-4cd4-9020-9b8acb483105:5829:1875724595107200:0@lo:503: 00000100:00100000:1.0:1788830447.770486:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830447.770498:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set 0000000053592d9a going to sleep for 11 seconds 00000100:00100000:1.0:1788830447.770509:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595107200 00000100:00100000:1.0:1788830447.770512:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595107200 00000100:00100000:1.0:1788830447.770531:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788830447.770536:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000335bc9e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1745cc3d-3952-4cd4-9020-9b8acb483105+14:5829:x1875724595107200:12345-0@lo:503: 00000100:00100000:1.0:1788830447.770693:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000335bc9e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1745cc3d-3952-4cd4-9020-9b8acb483105+14:5829:x1875724595107200:12345-0@lo:503: Request processed in 156us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830447.770700:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788830447.770758:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002ff5f425 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1745cc3d-3952-4cd4-9020-9b8acb483105:5829:1875724595107200:0@lo:503: 00000100:00100000:1.0:1788830447.770798:0:5819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fd78c6fb pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:MGS:5819:1875724595106944:0@lo:105: 00010000:00010000:1.0:1788830447.770816:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000008f1b9454/0x575506951eea08e9 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830447.770825:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788830447.770850:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fc93280f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1745cc3d-3952-4cd4-9020-9b8acb483105+13:3307:x1875724595106688:12345-0@lo:103: Request processed in 1087us (1568us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830447.770857:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788830447.770878:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000da84aedf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1745cc3d-3952-4cd4-9020-9b8acb483105:3307:1875724595106688:0@lo:103: 00000100:00100000:1.0:1788830447.771050:0:6693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000da84aedf pname:cluuid:pid:xid:nid:opc:job llog_process_th:1745cc3d-3952-4cd4-9020-9b8acb483105:6693:1875724595107328:0@lo:502: 00000100:00100000:1.0:1788830447.771084:0:6693:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830447.771101:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595107328 00000100:00100000:1.0:1788830447.771104:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595107328 00000100:00100000:1.0:1788830447.771123:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788830447.771128:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f7b8f3d2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1745cc3d-3952-4cd4-9020-9b8acb483105+13:6693:x1875724595107328:12345-0@lo:502: 00000100:00100000:1.0:1788830447.771253:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f7b8f3d2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1745cc3d-3952-4cd4-9020-9b8acb483105+13:6693:x1875724595107328:12345-0@lo:502: Request processed in 124us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830447.771260:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788830447.771287:0:6693:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ed0845e4 going to sleep for 11 seconds 00000100:00100000:1.0:1788830447.771297:0:6693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000da84aedf pname:cluuid:pid:xid:nid:opc:job llog_process_th:1745cc3d-3952-4cd4-9020-9b8acb483105:6693:1875724595107328:0@lo:502: 00000100:00100000:1.0:1788830447.771327:0:6693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000da84aedf pname:cluuid:pid:xid:nid:opc:job llog_process_th:1745cc3d-3952-4cd4-9020-9b8acb483105:6693:1875724595107456:0@lo:502: 00000100:00100000:1.0:1788830447.771352:0:6693:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830447.771366:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595107456 00000100:00100000:1.0:1788830447.771368:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595107456 00000100:00100000:1.0:1788830447.771383:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788830447.771387:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000065cbaa74 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1745cc3d-3952-4cd4-9020-9b8acb483105+13:6693:x1875724595107456:12345-0@lo:502: 00000100:00100000:1.0:1788830447.771476:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000065cbaa74 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1745cc3d-3952-4cd4-9020-9b8acb483105+13:6693:x1875724595107456:12345-0@lo:502: Request processed in 87us (123us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830447.771482:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788830447.771504:0:6693:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ed0845e4 going to sleep for 11 seconds 00000100:00100000:1.0:1788830447.771515:0:6693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000da84aedf pname:cluuid:pid:xid:nid:opc:job llog_process_th:1745cc3d-3952-4cd4-9020-9b8acb483105:6693:1875724595107456:0@lo:502: 00000040:00080000:1.0:1788830447.771532:0:6693:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:1.0:1788830447.771572:0:5829:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:1.0:1788830447.771584:0:5829:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.121@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788830447.771589:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: 000000007ff192a2/0x575506951eea08f0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea08f7 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830447.771606:0:5829:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.121@tcp lock: 000000007ff192a2/0x575506951eea08f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea08f7 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788830447.771614:0:5829:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1788830447.771616:0:5829:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:1.0:1788830447.771618:0:5829:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788830447.771632:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.121@tcp lock: 000000005c92837c/0x575506951eea08fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830447.773592:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000452b53bc/0x575506951eea089c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x575506951eea0895 expref: 12 pid: 5827 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788830447.773612:0:5824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000034d625f6 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5824:1875724595106048:0@lo:104: 00010000:00010000:3.0:1788830447.773622:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000ab0bf965/0x575506951eea082c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x575506951eea0825 expref: 11 pid: 5827 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788830447.773633:0:5824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b06174df pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5824:1875724595106176:0@lo:104: 00010000:00010000:3.0:1788830447.773650:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000c9fe41fa/0x575506951eea0810 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x575506951eea0809 expref: 10 pid: 5826 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788830447.773660:0:5824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000385ef33e pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5824:1875724595106304:0@lo:104: 00010000:00010000:3.0:1788830447.773680:0:5824:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000008f1b9454/0x575506951eea08e9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830447.773688:0:5824:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000008f1b9454/0x575506951eea08e9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830447.773693:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000008f1b9454/0x575506951eea08e9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830447.773698:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000008f1b9454/0x575506951eea08e9 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788830447.773726:0:5824:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00010000:00010000:1.0:1788830447.784182:0:5829:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.121@tcp lock: 000000005c92837c/0x575506951eea08fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830447.784200:0:5829:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.121@tcp lock: 000000005c92837c/0x575506951eea08fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788830447.784241:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000da84aedf pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1745cc3d-3952-4cd4-9020-9b8acb483105:5829:1875724595107584:0@lo:101: 00000100:00100000:1.0:1788830447.784315:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830447.784370:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ed0845e4 going to sleep for 11 seconds 00000100:00100000:2.0:1788830447.785233:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595107584 00000100:00100000:2.0:1788830447.785244:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595107584 00000100:00100000:2.0:1788830447.785299:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788830447.785308:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b39690d2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1745cc3d-3952-4cd4-9020-9b8acb483105+10:5829:x1875724595107584:12345-0@lo:101: 00010000:00010000:2.0:1788830447.785345:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788830447.785365:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005f611a07/0x575506951eea0905 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x575506951eea08fe expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830447.785411:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005f611a07/0x575506951eea0905 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x575506951eea08fe expref: 11 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830447.785423:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005f611a07/0x575506951eea0905 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x575506951eea08fe expref: 11 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830447.785432:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005f611a07, rc 0) 00000100:00100000:2.0:1788830447.787785:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b39690d2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1745cc3d-3952-4cd4-9020-9b8acb483105+11:5829:x1875724595107584:12345-0@lo:101: Request processed in 2470us (3461us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830447.787802:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788830447.789246:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000da84aedf pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1745cc3d-3952-4cd4-9020-9b8acb483105:5829:1875724595107584:0@lo:101: 00010000:00010000:3.0:1788830447.789279:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.121@tcp lock: 000000005c92837c/0x575506951eea08fe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea0905 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830447.789305:0:5829:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.121@tcp lock: 000000005c92837c/0x575506951eea08fe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x575506951eea0905 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788830447.789410:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000385ef33e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1745cc3d-3952-4cd4-9020-9b8acb483105:5829:1875724595107712:0@lo:501: 00000100:00100000:3.0:1788830447.789470:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830447.789500:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set 00000000fad32af9 going to sleep for 11 seconds 00000100:00100000:2.0:1788830447.789695:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595107712 00000100:00100000:2.0:1788830447.789703:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595107712 00000100:00100000:2.0:1788830447.789785:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788830447.789797:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009ef381a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1745cc3d-3952-4cd4-9020-9b8acb483105+11:5829:x1875724595107712:12345-0@lo:501: 00000100:00100000:2.0:1788830447.790288:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009ef381a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1745cc3d-3952-4cd4-9020-9b8acb483105+11:5829:x1875724595107712:12345-0@lo:501: Request processed in 493us (818us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830447.790296:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788830447.790358:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000385ef33e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1745cc3d-3952-4cd4-9020-9b8acb483105:5829:1875724595107712:0@lo:501: 00000100:00100000:3.0:1788830447.790388:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000385ef33e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1745cc3d-3952-4cd4-9020-9b8acb483105:5829:1875724595107840:0@lo:503: 00000100:00100000:3.0:1788830447.790429:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830447.790456:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set 00000000fad32af9 going to sleep for 11 seconds 00000100:00100000:2.0:1788830447.790493:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595107840 00000100:00100000:2.0:1788830447.790498:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595107840 00000100:00100000:2.0:1788830447.790528:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788830447.790534:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004db198bd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1745cc3d-3952-4cd4-9020-9b8acb483105+11:5829:x1875724595107840:12345-0@lo:503: 00000100:00100000:2.0:1788830447.790693:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004db198bd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1745cc3d-3952-4cd4-9020-9b8acb483105+11:5829:x1875724595107840:12345-0@lo:503: Request processed in 159us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830447.791321:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788830447.791378:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000385ef33e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1745cc3d-3952-4cd4-9020-9b8acb483105:5829:1875724595107840:0@lo:503: 00000100:00100000:2.0:1788830447.791861:0:6694:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008a2cdad9 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1745cc3d-3952-4cd4-9020-9b8acb483105:6694:1875724595107968:0@lo:502: 00000100:00100000:2.0:1788830447.791914:0:6694:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788830447.791954:0:6694:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ffe07d61 going to sleep for 11 seconds 00000100:00100000:1.0:1788830447.791954:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595107968 00000100:00100000:1.0:1788830447.791962:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595107968 00000100:00100000:1.0:1788830447.791994:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788830447.792002:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009e1a9b15 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1745cc3d-3952-4cd4-9020-9b8acb483105+11:6694:x1875724595107968:12345-0@lo:502: 00000100:00100000:1.0:1788830447.792807:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009e1a9b15 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1745cc3d-3952-4cd4-9020-9b8acb483105+11:6694:x1875724595107968:12345-0@lo:502: Request processed in 802us (891us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830447.792817:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788830447.793513:0:6694:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008a2cdad9 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1745cc3d-3952-4cd4-9020-9b8acb483105:6694:1875724595107968:0@lo:502: 00000020:01000000:2.0:1788830447.793556:0:6694:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788830447.793565:0:6694:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1788830447.793573:0:6694:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788830447.793575:0:6694:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1788830447.793579:0:6694:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788830447.793583:0:6694:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.121@tcp to nid 0x20000c0a8c979 (192.168.201.121@tcp) 00000020:01000000:2.0:1788830447.793612:0:6694:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788830447.793615:0:6694:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788830447.793631:0:6694:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (0000000034651ebb) 00000020:00000080:2.0:1788830447.793661:0:6694:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osp with refcount 2 00000020:00000080:2.0:1788830447.793668:0:6694:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788830447.793794:0:6694:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1788830447.793801:0:6694:0:(osd_handler.c:1573:osd_obd_connect()) connect #5 00000020:00000080:2.0:1788830447.793810:0:6694:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x575506951eea0913 00010000:00080000:2.0:1788830447.793848:0:6694:0:(ldlm_lib.c:102:import_set_conn()) imp 000000001971d0f9@lustre-OST0000-osc-MDT0000: add connection 192.168.201.121@tcp at head 00010000:00010000:2.0:1788830447.794095:0:6694:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000040:01000000:3.0:1788830447.862318:0:6694:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1788830447.862343:0:6694:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1788830447.863328:0:6694:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788830447.863489:0:6694:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788830447.863529:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:3.0:1788830447.863573:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000100:00100000:0.0:1788830447.864855:0:6675:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009b4df39d pname:cluuid:pid:xid:nid:opc:job mount.lustre:1745cc3d-3952-4cd4-9020-9b8acb483105:6675:1875724595105920:0@lo:253: 00000040:00080000:1.0:1788830447.864864:0:6696:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788830447.864868:0:6696:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 10000000:01000000:0.0:1788830447.864874:0:6675:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788830447.864878:0:6675:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788830447.864880:0:6675:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788830447.864881:0:6675:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788830447.864882:0:6675:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:0.0:1788830447.864884:0:6675:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788830447.864885:0:6675:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788830447.864886:0:6675:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788830447.864888:0:6675:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1788830447.864890:0:6675:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788830447.864891:0:6675:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788830447.864908:0:6675:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000d317ade2 from lustre-OST0000 10000000:01000000:0.0:1788830447.864925:0:6675:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1788830447.864928:0:6675:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788830447.864934:0:6675:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9e254482b370 local copy 10000000:01000000:0.0:1788830447.864948:0:6675:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00000100:00100000:2.0:1788830447.864950:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c8b2d3d0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+10:6675:x1875724595105920:12345-0@lo:253: Request processed in 120956us (124666us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830447.864962:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:0.0:1788830447.864982:0:6675:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.121@tcp lock: 000000008e8c75df/0x575506951eea091a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830447.864998:0:6675:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.121@tcp lock: 000000008e8c75df/0x575506951eea091a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830447.865008:0:6675:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.121@tcp lock: 000000008e8c75df/0x575506951eea091a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788830447.865025:0:6675:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005a5429d2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1745cc3d-3952-4cd4-9020-9b8acb483105:6675:1875724595108096:0@lo:101: 00000100:00100000:0.0:1788830447.865059:0:6675:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830447.865108:0:6675:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a9902461 going to sleep for 11 seconds 00000100:00100000:3.0:1788830447.865343:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595108096 00000100:00100000:3.0:1788830447.865350:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595108096 00000100:00100000:3.0:1788830447.865389:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788830447.865397:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009de30563 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1745cc3d-3952-4cd4-9020-9b8acb483105+10:6675:x1875724595108096:12345-0@lo:101: 00010000:00010000:3.0:1788830447.865411:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788830447.865423:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000008f1b9454/0x575506951eea0921 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x575506951eea091a expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830447.865446:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008f1b9454/0x575506951eea0921 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x575506951eea091a expref: 11 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830447.865467:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000008f1b9454/0x575506951eea0921 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x575506951eea091a expref: 11 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830447.865475:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000008f1b9454, rc 0) 00000100:00100000:3.0:1788830447.865518:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009de30563 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1745cc3d-3952-4cd4-9020-9b8acb483105+11:6675:x1875724595108096:12345-0@lo:101: Request processed in 121us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830447.865524:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788830447.865736:0:6675:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005a5429d2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1745cc3d-3952-4cd4-9020-9b8acb483105:6675:1875724595108096:0@lo:101: 00010000:00010000:0.0:1788830447.865750:0:6675:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.121@tcp lock: 000000008e8c75df/0x575506951eea091a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x575506951eea0921 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830447.865759:0:6675:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.121@tcp lock: 000000008e8c75df/0x575506951eea091a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x575506951eea0921 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788830447.865862:0:6675:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005a5429d2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1745cc3d-3952-4cd4-9020-9b8acb483105:6675:1875724595108224:0@lo:501: 00000100:00100000:0.0:1788830447.865889:0:6675:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830447.865929:0:6675:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a9902461 going to sleep for 11 seconds 00000100:00100000:3.0:1788830447.865930:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595108224 00000100:00100000:3.0:1788830447.865936:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595108224 00000100:00100000:3.0:1788830447.865967:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788830447.865973:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b745a9ad pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+11:6675:x1875724595108224:12345-0@lo:501: 00000100:00100000:3.0:1788830447.866155:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b745a9ad pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+11:6675:x1875724595108224:12345-0@lo:501: Request processed in 183us (266us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788830447.866162:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788830447.866250:0:6675:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005a5429d2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1745cc3d-3952-4cd4-9020-9b8acb483105:6675:1875724595108224:0@lo:501: 10000000:01000000:0.0:1788830447.866263:0:6675:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.121@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788830447.866289:0:6675:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.121@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788830447.866293:0:6675:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: 000000008e8c75df/0x575506951eea091a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x575506951eea0921 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830447.866299:0:6675:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: 000000008e8c75df/0x575506951eea091a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000400000000 nid: local remote: 0x575506951eea0921 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830447.866313:0:6675:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.121@tcp lock: 000000008e8c75df/0x575506951eea091a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000400000000 nid: local remote: 0x575506951eea0921 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830447.866338:0:6675:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788830447.866356:0:6675:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9e2565dcd800 00010000:00010000:3.0:1788830447.866358:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:01000000:0.0:1788830447.866362:0:6675:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788830447.866364:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.121@tcp lock: 000000008e8c75df/0x575506951eea091a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x400000000 nid: local remote: 0x575506951eea0921 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788830447.866368:0:6675:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9e254482b370 10000000:01000000:0.0:1788830447.866373:0:6675:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1788830447.866377:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000008e8c75df already unused, calling callback (0000000018a9601d) 10000000:01000000:0.0:1788830447.866379:0:6675:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e254482b370 from 1 10000000:01000000:0.0:1788830447.866383:0:6675:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 10000000:00010000:3.0:1788830447.866384:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.121@tcp lock: 000000008e8c75df/0x575506951eea091a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x400000000 nid: local remote: 0x575506951eea0921 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830447.866393:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.121@tcp lock: 000000008e8c75df/0x575506951eea091a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x8400000000 nid: local remote: 0x575506951eea0921 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788830447.866400:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.121@tcp lock: 000000008e8c75df/0x575506951eea091a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x9400000000 nid: local remote: 0x575506951eea0921 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830447.866403:0:6675:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.121@tcp lock: 00000000dc17adae/0x575506951eea0928 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830447.866411:0:6675:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.121@tcp lock: 00000000dc17adae/0x575506951eea0928 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788830447.866427:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788830447.866430:0:6675:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.121@tcp lock: 00000000dc17adae/0x575506951eea0928 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788830447.866443:0:6675:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005a5429d2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1745cc3d-3952-4cd4-9020-9b8acb483105:6675:1875724595108352:0@lo:101: 00010000:00010000:3.0:1788830447.866449:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.121@tcp lock: 000000008e8c75df/0x575506951eea091a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x4809400000020 nid: local remote: 0x575506951eea0921 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830447.866457:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788830447.866470:0:6675:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788830447.866477:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.121@tcp lock: 000000008e8c75df/0x575506951eea091a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x4809400000020 nid: local remote: 0x575506951eea0921 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830447.866486:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.121@tcp lock: 000000008e8c75df/0x575506951eea091a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x4809400000020 nid: local remote: 0x575506951eea0921 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788830447.866487:0:6675:0:(client.c:2715:ptlrpc_set_wait()) set 00000000706a8bbd going to sleep for 11 seconds 00010000:00010000:3.0:1788830447.866500:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788830447.866502:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788830447.866505:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788830447.866525:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595108352 00000100:00100000:0.0:1788830447.866530:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595108352 00000100:00100000:0.0:1788830447.866568:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788830447.866576:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007688195e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1745cc3d-3952-4cd4-9020-9b8acb483105+11:6675:x1875724595108352:12345-0@lo:101: 00010000:00010000:0.0:1788830447.866583:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788830447.866592:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c144d254/0x575506951eea092f lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x575506951eea0928 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830447.866612:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c144d254/0x575506951eea092f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x575506951eea0928 expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830447.866618:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c144d254/0x575506951eea092f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x575506951eea0928 expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830447.866625:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c144d254, rc 0) 00000100:00100000:0.0:1788830447.866673:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007688195e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1745cc3d-3952-4cd4-9020-9b8acb483105+12:6675:x1875724595108352:12345-0@lo:101: Request processed in 99us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830447.866679:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788830447.866735:0:6675:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005a5429d2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1745cc3d-3952-4cd4-9020-9b8acb483105:6675:1875724595108352:0@lo:101: 00010000:00010000:3.0:1788830447.866759:0:6675:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.121@tcp lock: 00000000dc17adae/0x575506951eea0928 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea092f expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788830447.866763:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b06174df pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1745cc3d-3952-4cd4-9020-9b8acb483105:3308:1875724595108480:0@lo:103: 00010000:00010000:3.0:1788830447.866774:0:6675:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.121@tcp lock: 00000000dc17adae/0x575506951eea0928 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x575506951eea092f expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788830447.866791:0:6675:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.121@tcp: configuration from log 'nodemap' succeeded (0). 00000100:00100000:0.0:1788830447.866797:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788830447.866798:0:6675:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: 00000000dc17adae/0x575506951eea0928 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea092f expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830447.866807:0:6675:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.121@tcp lock: 00000000dc17adae/0x575506951eea0928 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea092f expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788830447.866813:0:6675:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788830447.866824:0:6675:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788830447.866829:0:6675:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1788830447.866832:0:6675:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788830447.866846:0:6675:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.121@tcp lock: 00000000ab0bf965/0x575506951eea0936 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830447.866851:0:6675:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.121@tcp lock: 00000000ab0bf965/0x575506951eea0936 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830447.866856:0:6675:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.121@tcp lock: 00000000ab0bf965/0x575506951eea0936 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788830447.866863:0:6675:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000034d625f6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1745cc3d-3952-4cd4-9020-9b8acb483105:6675:1875724595108608:0@lo:101: 00000100:00100000:3.0:1788830447.866882:0:6675:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830447.866906:0:6675:0:(client.c:2715:ptlrpc_set_wait()) set 00000000bc787b08 going to sleep for 11 seconds 00000100:00100000:2.0:1788830447.866998:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595108480 00000100:00100000:2.0:1788830447.867003:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595108480 00000100:00100000:2.0:1788830447.867042:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788830447.867049:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c9a5f68f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1745cc3d-3952-4cd4-9020-9b8acb483105+12:3308:x1875724595108480:12345-0@lo:103: 00010000:00010000:2.0:1788830447.867065:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788830447.867076:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000008f1b9454/0x575506951eea0921 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x575506951eea091a expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830447.867086:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788830447.867102:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595108608 00000100:00100000:0.0:1788830447.867107:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595108608 00000100:00100000:2.0:1788830447.867117:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c9a5f68f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1745cc3d-3952-4cd4-9020-9b8acb483105+12:3308:x1875724595108480:12345-0@lo:103: Request processed in 70us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830447.867123:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788830447.867136:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788830447.867142:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000063f1decc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+11:6675:x1875724595108608:12345-0@lo:101: 00010000:00010000:0.0:1788830447.867149:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788830447.867164:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000452b53bc/0x575506951eea093d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x575506951eea0936 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830447.867178:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000452b53bc/0x575506951eea093d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x575506951eea0936 expref: 12 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830447.867185:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000452b53bc/0x575506951eea093d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x575506951eea0936 expref: 12 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830447.867191:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000452b53bc, rc 0) 00000100:00100000:0.0:1788830447.867237:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000063f1decc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+12:6675:x1875724595108608:12345-0@lo:101: Request processed in 94us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830447.867243:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788830447.867271:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b06174df pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1745cc3d-3952-4cd4-9020-9b8acb483105:3308:1875724595108480:0@lo:103: 00000100:00100000:3.0:1788830447.867315:0:6675:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000034d625f6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1745cc3d-3952-4cd4-9020-9b8acb483105:6675:1875724595108608:0@lo:101: 00010000:00010000:3.0:1788830447.867322:0:6675:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.121@tcp lock: 00000000ab0bf965/0x575506951eea0936 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea093d expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830447.867327:0:6675:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.121@tcp lock: 00000000ab0bf965/0x575506951eea0936 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x575506951eea093d expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788830447.867375:0:6675:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000034d625f6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1745cc3d-3952-4cd4-9020-9b8acb483105:6675:1875724595108736:0@lo:501: 00000100:00100000:3.0:1788830447.867402:0:6675:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830447.867419:0:6675:0:(client.c:2715:ptlrpc_set_wait()) set 00000000bc787b08 going to sleep for 11 seconds 00000100:00100000:2.0:1788830447.867604:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595108736 00000100:00100000:2.0:1788830447.867608:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595108736 00000100:00100000:2.0:1788830447.867645:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788830447.867651:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bb8728d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1745cc3d-3952-4cd4-9020-9b8acb483105+12:6675:x1875724595108736:12345-0@lo:501: 00000100:00100000:2.0:1788830447.867861:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bb8728d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1745cc3d-3952-4cd4-9020-9b8acb483105+12:6675:x1875724595108736:12345-0@lo:501: Request processed in 210us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830447.867867:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788830447.867889:0:6675:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000034d625f6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1745cc3d-3952-4cd4-9020-9b8acb483105:6675:1875724595108736:0@lo:501: 00000100:00100000:3.0:1788830447.868318:0:6675:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000034d625f6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1745cc3d-3952-4cd4-9020-9b8acb483105:6675:1875724595108864:0@lo:503: 00000100:00100000:3.0:1788830447.868355:0:6675:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830447.868394:0:6675:0:(client.c:2715:ptlrpc_set_wait()) set 00000000bc787b08 going to sleep for 11 seconds 00000100:00100000:0.0:1788830447.868867:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595108864 00000100:00100000:0.0:1788830447.868874:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595108864 00000100:00100000:0.0:1788830447.868909:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788830447.868916:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000012f24972 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+12:6675:x1875724595108864:12345-0@lo:503: 00000100:00100000:0.0:1788830447.869780:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000012f24972 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+12:6675:x1875724595108864:12345-0@lo:503: Request processed in 863us (1423us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830447.869791:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788830447.869816:0:6675:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000034d625f6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1745cc3d-3952-4cd4-9020-9b8acb483105:6675:1875724595108864:0@lo:503: 00000040:00080000:3.0:1788830447.870266:0:6675:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788830447.870347:0:6675:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000034d625f6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1745cc3d-3952-4cd4-9020-9b8acb483105:6675:1875724595108992:0@lo:502: 00000100:00100000:3.0:1788830447.870386:0:6675:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830447.870475:0:6675:0:(client.c:2715:ptlrpc_set_wait()) set 00000000bc787b08 going to sleep for 11 seconds 00000100:00100000:1.0:1788830447.870586:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595108992 00000100:00100000:1.0:1788830447.870597:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595108992 00000100:00100000:1.0:1788830447.870684:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788830447.870692:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f4e07ec0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1745cc3d-3952-4cd4-9020-9b8acb483105+12:6675:x1875724595108992:12345-0@lo:502: 00000100:00100000:1.0:1788830447.871039:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f4e07ec0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1745cc3d-3952-4cd4-9020-9b8acb483105+12:6675:x1875724595108992:12345-0@lo:502: Request processed in 203us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830447.871047:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788830447.871275:0:6675:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000034d625f6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1745cc3d-3952-4cd4-9020-9b8acb483105:6675:1875724595108992:0@lo:502: 00000020:00000080:0.0:1788830447.871410:0:6694:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788830447.871423:0:6694:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788830447.871466:0:6694:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1788830447.871486:0:6694:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x575506951eea0944 00000100:00080000:0.0:1788830447.871494:0:6694:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788830447.871498:0:6694:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import 000000001971d0f9 using connection 192.168.201.121@tcp/0@lo 00000100:00100000:0.0:1788830447.871525:0:6694:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000004ccf18a3 x1875724595109120/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788830447.871554:0:6694:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000040:00080000:3.0:1788830447.871598:0:6675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000020:01000000:0.0:1788830447.871627:0:6694:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788830447.871632:0:6694:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788830447.871643:0:6694:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000100:00100000:2.0:1788830447.871645:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004ccf18a3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1875724595109120:0@lo:8: 00000020:01000000:0.0:1788830447.871648:0:6694:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788830447.871653:0:6694:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788830447.871655:0:6694:0:(obd_config.c:1563:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788830447.871659:0:6694:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788830447.871661:0:6694:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788830447.871684:0:6694:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c2caebd6 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1745cc3d-3952-4cd4-9020-9b8acb483105:6694:1875724595109248:0@lo:502: 00000100:00100000:2.0:1788830447.871688:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830447.871738:0:6694:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788830447.871759:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595109120 00000100:00100000:0.0:1788830447.871760:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595109248 00000100:00100000:2.0:1788830447.871763:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595109120 00000100:00100000:0.0:1788830447.871763:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595109248 00000100:00100000:2.0:1788830447.871783:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788830447.871784:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788830447.871788:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008a2cdad9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3306:x1875724595109120:12345-0@lo:8: 00000100:00100000:0.0:1788830447.871789:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c3ae6879 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+12:6694:x1875724595109248:12345-0@lo:502: 00010000:00020000:2.0:1788830447.871800:0:6677:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000040:00080000:3.0:1788830447.871815:0:6675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000100:00100000:2.0:1788830447.871835:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008a2cdad9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3306:x1875724595109120:12345-0@lo:8: Request processed in 46us (147us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788830447.871843:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1788830447.871870:0:3306:0:(import.c:65:import_set_state_nolock()) 000000001971d0f9 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788830447.871874:0:3306:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788830447.871882:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004ccf18a3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1875724595109120:0@lo:8: 00000100:00100000:0.0:1788830447.871988:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c3ae6879 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+12:6694:x1875724595109248:12345-0@lo:502: Request processed in 199us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830447.871994:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788830447.872029:0:6694:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b81f2f8a going to sleep for 11 seconds 00000100:00100000:0.0:1788830447.872040:0:6694:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c2caebd6 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1745cc3d-3952-4cd4-9020-9b8acb483105:6694:1875724595109248:0@lo:502: 00000020:01000000:0.0:1788830447.872057:0:6694:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788830447.872062:0:6694:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788830447.872064:0:6694:0:(obd_config.c:1563:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788830447.872067:0:6694:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000040:00080000:3.0:1788830447.872121:0:6675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1788830447.872204:0:6675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1788830447.872245:0:6675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1788830447.872277:0:6675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1788830447.872297:0:6675:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000034d625f6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1745cc3d-3952-4cd4-9020-9b8acb483105:6675:1875724595109376:0@lo:502: 00000100:00100000:3.0:1788830447.872332:0:6675:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830447.872356:0:6675:0:(client.c:2715:ptlrpc_set_wait()) set 00000000bc787b08 going to sleep for 11 seconds 00000100:00100000:1.0:1788830447.872419:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595109376 00000100:00100000:1.0:1788830447.872423:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595109376 00000100:00100000:1.0:1788830447.872487:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788830447.872493:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000045329da3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1745cc3d-3952-4cd4-9020-9b8acb483105+12:6675:x1875724595109376:12345-0@lo:502: 00000020:01000000:2.0:1788830447.872512:0:5829:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:2.0:1788830447.872535:0:5829:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.121@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788830447.872543:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: 000000005c92837c/0x575506951eea08fe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea0905 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830447.872553:0:5829:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.121@tcp lock: 000000005c92837c/0x575506951eea08fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea0905 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788830447.872564:0:5829:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788830447.872567:0:5829:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e255d9b0800 from 1 10000000:01000000:2.0:1788830447.872570:0:5829:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788830447.872596:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.121@tcp lock: 00000000c9fe41fa/0x575506951eea094b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830447.872604:0:5829:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.121@tcp lock: 00000000c9fe41fa/0x575506951eea094b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830447.872614:0:5829:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.121@tcp lock: 00000000c9fe41fa/0x575506951eea094b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788830447.872627:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006ac94947 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1745cc3d-3952-4cd4-9020-9b8acb483105:5829:1875724595109504:0@lo:101: 00000100:00100000:1.0:1788830447.872656:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000045329da3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1745cc3d-3952-4cd4-9020-9b8acb483105+12:6675:x1875724595109376:12345-0@lo:502: Request processed in 163us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830447.872665:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788830447.872671:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788830447.874783:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set 00000000fbed64cb going to sleep for 11 seconds 00000100:00100000:2.0:1788830447.875814:0:6675:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000034d625f6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1745cc3d-3952-4cd4-9020-9b8acb483105:6675:1875724595109376:0@lo:502: 00000040:00080000:2.0:1788830447.876011:0:6675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1788830447.876027:0:6675:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000100:00100000:3.0:1788830447.876349:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595109504 00000100:00100000:3.0:1788830447.876359:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595109504 00000100:00100000:3.0:1788830447.876406:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788830447.876414:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000412642f5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1745cc3d-3952-4cd4-9020-9b8acb483105+12:5829:x1875724595109504:12345-0@lo:101: 00010000:00010000:3.0:1788830447.876429:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788830447.876445:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000020a124de/0x575506951eea0952 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x575506951eea094b expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830447.876469:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000020a124de/0x575506951eea0952 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x575506951eea094b expref: 13 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830447.876480:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000020a124de/0x575506951eea0952 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x575506951eea094b expref: 13 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830447.876507:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000020a124de, rc 0) 00000100:00100000:3.0:1788830447.876589:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000412642f5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1745cc3d-3952-4cd4-9020-9b8acb483105+13:5829:x1875724595109504:12345-0@lo:101: Request processed in 175us (3918us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830447.876596:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788830447.876602:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006ac94947 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1745cc3d-3952-4cd4-9020-9b8acb483105:5829:1875724595109504:0@lo:101: 00010000:00010000:2.0:1788830447.876619:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.121@tcp lock: 00000000c9fe41fa/0x575506951eea094b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea0952 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830447.876649:0:5829:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.121@tcp lock: 00000000c9fe41fa/0x575506951eea094b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x575506951eea0952 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788830447.876706:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006ac94947 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1745cc3d-3952-4cd4-9020-9b8acb483105:5829:1875724595109632:0@lo:501: 00000100:00100000:2.0:1788830447.876761:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788830447.876784:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set 00000000edababf9 going to sleep for 11 seconds 00000100:00100000:3.0:1788830447.876887:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595109632 00000100:00100000:3.0:1788830447.876891:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595109632 00000100:00100000:3.0:1788830447.877238:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788830447.877244:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000291e6508 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1745cc3d-3952-4cd4-9020-9b8acb483105+13:5829:x1875724595109632:12345-0@lo:501: 00000100:00100000:3.0:1788830447.877532:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000291e6508 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1745cc3d-3952-4cd4-9020-9b8acb483105+13:5829:x1875724595109632:12345-0@lo:501: Request processed in 288us (771us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830447.877539:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788830447.877570:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006ac94947 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1745cc3d-3952-4cd4-9020-9b8acb483105:5829:1875724595109632:0@lo:501: 00000100:00100000:3.0:1788830447.877599:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006db26227 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1745cc3d-3952-4cd4-9020-9b8acb483105:5829:1875724595109760:0@lo:503: 00000100:00100000:3.0:1788830447.877648:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830447.877670:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set 00000000bc787b08 going to sleep for 11 seconds 00000020:01000000:2.0:1788830447.877828:0:6698:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788830447.877836:0:6698:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:2.0:1788830447.877842:0:6698:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788830447.877844:0:6698:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1788830447.877848:0:6698:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788830447.877861:0:6698:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (00000000e0454f15) 00000020:00000080:2.0:1788830447.877880:0:6698:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788830447.877886:0:6698:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788830447.878148:0:6698:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000d317ade2 from lustre-OST0000, refs=2 00080000:01000000:2.0:1788830447.878157:0:6698:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788830447.878165:0:6698:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x575506951eea0960 00000100:00100000:3.0:1788830447.878857:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595109760 00000100:00100000:3.0:1788830447.878862:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595109760 00000100:00100000:3.0:1788830447.878891:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788830447.879404:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ea6a376e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1745cc3d-3952-4cd4-9020-9b8acb483105+13:5829:x1875724595109760:12345-0@lo:503: 00000100:00100000:3.0:1788830447.879689:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ea6a376e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1745cc3d-3952-4cd4-9020-9b8acb483105+13:5829:x1875724595109760:12345-0@lo:503: Request processed in 288us (2040us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830447.879698:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788830447.879733:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006db26227 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1745cc3d-3952-4cd4-9020-9b8acb483105:5829:1875724595109760:0@lo:503: 00000100:00100000:0.0:1788830447.882792:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c2caebd6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875724595109888:0@lo:400: 00000100:00100000:0.0:1788830447.882872:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830447.883096:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595109888 00000100:00100000:0.0:1788830447.883105:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595109888 00000100:00100000:0.0:1788830447.883161:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788830447.883170:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009446402d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875724595109888:12345-0@lo:400: 00000100:00100000:0.0:1788830447.883518:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009446402d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875724595109888:12345-0@lo:400: Request processed in 341us (637us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830447.883526:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788830447.883574:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000c2caebd6 x1875724595109888/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788830463 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788830447.883600:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c2caebd6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875724595109888:0@lo:400: 00000100:00100000:3.0:1788830447.883972:0:6699:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d00950f3 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1745cc3d-3952-4cd4-9020-9b8acb483105:6699:1875724595110016:0@lo:502: 00000100:00100000:3.0:1788830447.884021:0:6699:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830447.884061:0:6699:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f472227f going to sleep for 11 seconds 00000100:00100000:0.0:1788830447.884066:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595110016 00000100:00100000:0.0:1788830447.884073:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595110016 00000100:00100000:0.0:1788830447.884111:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788830447.884120:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000006921cfc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+13:6699:x1875724595110016:12345-0@lo:502: 00000100:00100000:0.0:1788830447.884473:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000006921cfc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+13:6699:x1875724595110016:12345-0@lo:502: Request processed in 353us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830447.884484:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788830447.884567:0:6699:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d00950f3 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1745cc3d-3952-4cd4-9020-9b8acb483105:6699:1875724595110016:0@lo:502: 00000020:01000000:0.0:1788830447.884602:0:6699:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788830447.884611:0:6699:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788830447.884613:0:6699:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788830447.884621:0:6699:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e255d9b0800 00000020:00000080:0.0:1788830447.884623:0:6699:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788830447.884676:0:6699:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25479a0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1745cc3d-3952-4cd4-9020-9b8acb483105:6699:1875724595110144:0@lo:502: 00000100:00100000:0.0:1788830447.884737:0:6699:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830447.884752:0:6699:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e257fc23780 going to sleep for 11 seconds 00000100:00100000:3.0:1788830447.885784:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595110144 00000100:00100000:3.0:1788830447.885793:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595110144 00000100:00100000:3.0:1788830447.885837:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788830447.885847:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255d94b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1745cc3d-3952-4cd4-9020-9b8acb483105+13:6699:x1875724595110144:12345-0@lo:502: 00000100:00100000:3.0:1788830447.886028:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255d94b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1745cc3d-3952-4cd4-9020-9b8acb483105+13:6699:x1875724595110144:12345-0@lo:502: Request processed in 183us (1291us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830447.886036:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788830447.886236:0:6699:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25479a0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1745cc3d-3952-4cd4-9020-9b8acb483105:6699:1875724595110144:0@lo:502: 00010000:00010000:2.0:1788830447.886249:0:6698:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000020:01000000:0.0:1788830447.886269:0:6699:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788830447.886276:0:6699:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788830447.886278:0:6699:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1788830447.886282:0:6699:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000001:02000400:2.0:1788830447.886522:0:6698:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000020:01000000:3.0:1788830447.886865:0:5829:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1788830447.886885:0:5829:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788830447.886897:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: ffff9e257d80e800/0x575506951eea094b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea0952 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830447.886907:0:5829:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.121@tcp lock: ffff9e257d80e800/0x575506951eea094b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea0952 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788830447.886916:0:5829:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1788830447.886919:0:5829:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9e254482b370 from 1 10000000:01000000:3.0:1788830447.886922:0:5829:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788830447.886953:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.121@tcp lock: ffff9e257d945200/0x575506951eea0967 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830447.886961:0:5829:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.121@tcp lock: ffff9e257d945200/0x575506951eea0967 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830447.886970:0:5829:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.121@tcp lock: ffff9e257d945200/0x575506951eea0967 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788830447.886986:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257f805880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1745cc3d-3952-4cd4-9020-9b8acb483105:5829:1875724595110272:0@lo:101: 00000100:00100000:3.0:1788830447.887026:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830447.887069:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e25472ef300 going to sleep for 11 seconds 00000100:00100000:0.0:1788830447.887080:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595110272 00000100:00100000:0.0:1788830447.887087:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595110272 00000100:00100000:0.0:1788830447.887122:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788830447.887130:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255d94a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+13:5829:x1875724595110272:12345-0@lo:101: 00010000:00010000:0.0:1788830447.887148:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788830447.887225:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2540031c00/0x575506951eea096e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x575506951eea0967 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830447.887249:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2540031c00/0x575506951eea096e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x575506951eea0967 expref: 14 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830447.887260:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2540031c00/0x575506951eea096e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x575506951eea0967 expref: 14 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830447.887269:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2540031c00, rc 0) 00000100:00100000:0.0:1788830447.887361:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255d94a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+14:5829:x1875724595110272:12345-0@lo:101: Request processed in 231us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830447.887369:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788830447.889252:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257f805880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1745cc3d-3952-4cd4-9020-9b8acb483105:5829:1875724595110272:0@lo:101: 00010000:00010000:3.0:1788830447.889278:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.121@tcp lock: ffff9e257d945200/0x575506951eea0967 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea096e expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830447.889290:0:5829:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.121@tcp lock: ffff9e257d945200/0x575506951eea0967 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x575506951eea096e expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788830447.889358:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257f805880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1745cc3d-3952-4cd4-9020-9b8acb483105:5829:1875724595110400:0@lo:501: 00000100:00100000:3.0:1788830447.889405:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830447.889448:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e25472ef300 going to sleep for 11 seconds 00000100:00100000:1.0:1788830447.889470:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595110400 00000100:00100000:1.0:1788830447.889477:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595110400 00000100:00100000:1.0:1788830447.889530:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788830447.889546:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255d94bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1745cc3d-3952-4cd4-9020-9b8acb483105+14:5829:x1875724595110400:12345-0@lo:501: 00000100:00100000:1.0:1788830447.889902:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255d94bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1745cc3d-3952-4cd4-9020-9b8acb483105+14:5829:x1875724595110400:12345-0@lo:501: Request processed in 362us (495us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788830447.889911:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788830447.890046:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257f805880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1745cc3d-3952-4cd4-9020-9b8acb483105:5829:1875724595110400:0@lo:501: 10000000:01000000:3.0:1788830447.890069:0:5829:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.121@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788830447.890076:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: ffff9e257d945200/0x575506951eea0967 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea096e expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830447.890084:0:5829:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.121@tcp lock: ffff9e257d945200/0x575506951eea0967 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea096e expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:0.0:1788830447.890486:0:6698:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1788830447.891104:0:6698:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:0.0:1788830447.897909:0:6698:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:0.0:1788830447.898381:0:6698:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:0.0:1788830447.903353:0:6698:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1788830447.903366:0:6698:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788830447.903373:0:6698:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788830447.903375:0:6698:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1788830447.903379:0:6698:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788830447.903383:0:6698:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788830447.903385:0:6698:0:(obd_config.c:1563:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788830447.903388:0:6698:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788830447.903390:0:6698:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788830447.903458:0:6698:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788830447.903462:0:6698:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788830447.903463:0:6698:0:(obd_config.c:1563:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788830447.903473:0:6698:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1788830447.903587:0:6675:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:3.0:1788830447.903620:0:6675:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.121@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788830447.903652:0:6675:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: ffff9e257d944000/0x575506951eea0936 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea093d expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830447.903665:0:6675:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.121@tcp lock: ffff9e257d944000/0x575506951eea0936 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea093d expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788830447.903674:0:6675:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e2565dcd800 from 1 10000000:01000000:3.0:1788830447.903683:0:6675:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788830447.903749:0:6675:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.121@tcp lock: ffff9e257d944400/0x575506951eea0975 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830447.903758:0:6675:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.121@tcp lock: ffff9e257d944400/0x575506951eea0975 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830447.903768:0:6675:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.121@tcp lock: ffff9e257d944400/0x575506951eea0975 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788830447.903791:0:6675:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257f805880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1745cc3d-3952-4cd4-9020-9b8acb483105:6675:1875724595110528:0@lo:101: 00000100:00100000:3.0:1788830447.903857:0:6675:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830447.903912:0:6675:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e25472ef300 going to sleep for 11 seconds 00000100:00100000:1.0:1788830447.903915:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595110528 00000100:00100000:1.0:1788830447.903923:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595110528 00000100:00100000:1.0:1788830447.903983:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788830447.903994:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25474a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+14:6675:x1875724595110528:12345-0@lo:101: 00010000:00010000:1.0:1788830447.904007:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788830447.904021:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e25820ffe00/0x575506951eea097c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x575506951eea0975 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830447.904056:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e25820ffe00/0x575506951eea097c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x575506951eea0975 expref: 15 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830447.904066:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e25820ffe00/0x575506951eea097c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x575506951eea0975 expref: 15 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830447.904074:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e25820ffe00, rc 0) 00000100:00100000:1.0:1788830447.904116:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25474a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+15:6675:x1875724595110528:12345-0@lo:101: Request processed in 124us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830447.904124:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788830447.904145:0:6675:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257f805880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1745cc3d-3952-4cd4-9020-9b8acb483105:6675:1875724595110528:0@lo:101: 00010000:00010000:3.0:1788830447.904172:0:6675:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.121@tcp lock: ffff9e257d944400/0x575506951eea0975 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea097c expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830447.904183:0:6675:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.121@tcp lock: ffff9e257d944400/0x575506951eea0975 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x575506951eea097c expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788830447.904283:0:6675:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257f805880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1745cc3d-3952-4cd4-9020-9b8acb483105:6675:1875724595110656:0@lo:501: 00000100:00100000:3.0:1788830447.904314:0:6675:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830447.904334:0:6675:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e25472ef300 going to sleep for 11 seconds 00000100:00100000:1.0:1788830447.904361:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595110656 00000100:00100000:1.0:1788830447.904367:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595110656 00000100:00100000:1.0:1788830447.904396:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788830447.904403:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25474aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1745cc3d-3952-4cd4-9020-9b8acb483105+15:6675:x1875724595110656:12345-0@lo:501: 00000100:00100000:1.0:1788830447.904810:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25474aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1745cc3d-3952-4cd4-9020-9b8acb483105+15:6675:x1875724595110656:12345-0@lo:501: Request processed in 406us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830447.904818:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788830447.904848:0:6675:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257f805880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1745cc3d-3952-4cd4-9020-9b8acb483105:6675:1875724595110656:0@lo:501: 00000100:00100000:3.0:1788830447.904876:0:6675:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257f805880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1745cc3d-3952-4cd4-9020-9b8acb483105:6675:1875724595110784:0@lo:503: 00000100:00100000:3.0:1788830447.904911:0:6675:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830447.904945:0:6675:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e25472ef300 going to sleep for 11 seconds 00000100:00100000:1.0:1788830447.904966:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595110784 00000100:00100000:1.0:1788830447.904972:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595110784 00000100:00100000:1.0:1788830447.905002:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788830447.905009:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25474ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+15:6675:x1875724595110784:12345-0@lo:503: 00000100:00100000:1.0:1788830447.905151:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25474ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+15:6675:x1875724595110784:12345-0@lo:503: Request processed in 141us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830447.905158:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788830447.905235:0:6675:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257f805880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1745cc3d-3952-4cd4-9020-9b8acb483105:6675:1875724595110784:0@lo:503: 00000040:00080000:3.0:1788830447.905486:0:6675:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788830447.905526:0:6675:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257f805880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1745cc3d-3952-4cd4-9020-9b8acb483105:6675:1875724595110912:0@lo:502: 00000100:00100000:3.0:1788830447.905552:0:6675:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830447.905572:0:6675:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e25472ef300 going to sleep for 11 seconds 00000100:00100000:1.0:1788830447.905619:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595110912 00000100:00100000:1.0:1788830447.905623:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595110912 00000100:00100000:1.0:1788830447.905684:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788830447.905695:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25474a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1745cc3d-3952-4cd4-9020-9b8acb483105+15:6675:x1875724595110912:12345-0@lo:502: 00000100:00100000:1.0:1788830447.905963:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25474a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1745cc3d-3952-4cd4-9020-9b8acb483105+15:6675:x1875724595110912:12345-0@lo:502: Request processed in 267us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830447.905971:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788830447.906078:0:6675:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257f805880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1745cc3d-3952-4cd4-9020-9b8acb483105:6675:1875724595110912:0@lo:502: 00000040:00080000:3.0:1788830447.906351:0:6675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1788830447.906398:0:6675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1788830447.906421:0:6675:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257f805880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1745cc3d-3952-4cd4-9020-9b8acb483105:6675:1875724595111040:0@lo:502: 00000100:00100000:3.0:1788830447.906451:0:6675:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830447.906519:0:6675:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e25472ef300 going to sleep for 11 seconds 00000100:00100000:1.0:1788830447.906573:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595111040 00000100:00100000:1.0:1788830447.906577:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595111040 00000100:00100000:1.0:1788830447.906624:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788830447.906629:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25474aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+15:6675:x1875724595111040:12345-0@lo:502: 00000100:00100000:1.0:1788830447.906746:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25474aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+15:6675:x1875724595111040:12345-0@lo:502: Request processed in 116us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830447.906750:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788830447.907401:0:6675:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257f805880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1745cc3d-3952-4cd4-9020-9b8acb483105:6675:1875724595111040:0@lo:502: 00000040:00080000:0.0:1788830447.917237:0:6675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1788830447.917258:0:6675:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1788830447.919956:0:6703:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788830447.919969:0:6703:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788830447.919972:0:6703:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788830447.919980:0:6703:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e2565dcd800 00000020:00000080:2.0:1788830447.919982:0:6703:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788830447.920003:0:6703:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788830447.920006:0:6703:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788830447.920008:0:6703:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1788830447.920011:0:6703:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1788830447.920286:0:6675:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1788830447.920312:0:6675:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788830447.920335:0:6675:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: ffff9e257d944400/0x575506951eea0975 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea097c expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830447.920348:0:6675:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.121@tcp lock: ffff9e257d944400/0x575506951eea0975 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea097c expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788830447.920394:0:6675:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788830447.920397:0:6675:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9e2565dcd800 10000000:01000000:3.0:1788830447.920400:0:6675:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9e2565dcd800 10000000:01000000:3.0:1788830447.920404:0:6675:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788830447.920410:0:6675:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9e2565dcd800 from 1 10000000:01000000:3.0:1788830447.920412:0:6675:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788830447.920552:0:6675:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.121@tcp lock: ffff9e257d944800/0x575506951eea0983 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830447.920562:0:6675:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.121@tcp lock: ffff9e257d944800/0x575506951eea0983 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830447.920585:0:6675:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.121@tcp lock: ffff9e257d944800/0x575506951eea0983 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788830447.920606:0:6675:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257f805180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1745cc3d-3952-4cd4-9020-9b8acb483105:6675:1875724595111168:0@lo:101: 00000100:00100000:3.0:1788830447.920988:0:6675:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830447.921036:0:6675:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e25472ef6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788830447.921200:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595111168 00000100:00100000:1.0:1788830447.921208:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595111168 00000100:00100000:1.0:1788830447.921254:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788830447.921265:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25747bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1745cc3d-3952-4cd4-9020-9b8acb483105+15:6675:x1875724595111168:12345-0@lo:101: 00010000:00010000:1.0:1788830447.921278:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788830447.921292:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e25820fe600/0x575506951eea098a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x575506951eea0983 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830447.921316:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e25820fe600/0x575506951eea098a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x575506951eea0983 expref: 16 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830447.921326:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e25820fe600/0x575506951eea098a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x575506951eea0983 expref: 16 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830447.921335:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e25820fe600, rc 0) 00000100:00100000:1.0:1788830447.921382:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25747bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1745cc3d-3952-4cd4-9020-9b8acb483105+16:6675:x1875724595111168:12345-0@lo:101: Request processed in 119us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830447.921399:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788830447.921526:0:6675:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257f805180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1745cc3d-3952-4cd4-9020-9b8acb483105:6675:1875724595111168:0@lo:101: 00010000:00010000:3.0:1788830447.921542:0:6675:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.121@tcp lock: ffff9e257d944800/0x575506951eea0983 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea098a expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830447.921552:0:6675:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.121@tcp lock: ffff9e257d944800/0x575506951eea0983 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x575506951eea098a expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788830447.921652:0:6675:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257f805180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1745cc3d-3952-4cd4-9020-9b8acb483105:6675:1875724595111296:0@lo:501: 00000100:00100000:3.0:1788830447.921680:0:6675:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830447.921702:0:6675:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e25472ef6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788830447.921750:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595111296 00000100:00100000:1.0:1788830447.921755:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595111296 00000100:00100000:1.0:1788830447.924567:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788830447.924591:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25747bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+16:6675:x1875724595111296:12345-0@lo:501: 00000100:00100000:1.0:1788830447.925777:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25747bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+16:6675:x1875724595111296:12345-0@lo:501: Request processed in 826us (3724us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830447.925788:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788830447.926038:0:6675:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257f805180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1745cc3d-3952-4cd4-9020-9b8acb483105:6675:1875724595111296:0@lo:501: 00000100:00100000:3.0:1788830447.926089:0:6675:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257f805180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1745cc3d-3952-4cd4-9020-9b8acb483105:6675:1875724595111424:0@lo:503: 00000100:00100000:3.0:1788830447.926145:0:6675:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830447.926186:0:6675:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e25472ef6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788830447.926198:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595111424 00000100:00100000:1.0:1788830447.926206:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595111424 00000100:00100000:1.0:1788830447.926249:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788830447.926257:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25747bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1745cc3d-3952-4cd4-9020-9b8acb483105+16:6675:x1875724595111424:12345-0@lo:503: 00000100:00100000:1.0:1788830447.926901:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25747bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1745cc3d-3952-4cd4-9020-9b8acb483105+16:6675:x1875724595111424:12345-0@lo:503: Request processed in 643us (754us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830447.926909:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788830447.928997:0:6675:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257f805180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1745cc3d-3952-4cd4-9020-9b8acb483105:6675:1875724595111424:0@lo:503: 00000040:00080000:3.0:1788830447.930990:0:6675:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788830447.931224:0:6675:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257f805180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1745cc3d-3952-4cd4-9020-9b8acb483105:6675:1875724595111552:0@lo:502: 00000100:00100000:3.0:1788830447.931296:0:6675:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830447.931380:0:6675:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e25472ef6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788830447.933518:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595111552 00000100:00100000:1.0:1788830447.933532:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595111552 00000100:00100000:1.0:1788830447.933628:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788830447.933649:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25747bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+16:6675:x1875724595111552:12345-0@lo:502: 00000100:00100000:1.0:1788830447.933988:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25747bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+16:6675:x1875724595111552:12345-0@lo:502: Request processed in 350us (2690us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830447.933996:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788830447.934126:0:6675:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257f805180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1745cc3d-3952-4cd4-9020-9b8acb483105:6675:1875724595111552:0@lo:502: 00000040:00080000:0.0:1788830447.934433:0:6675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1788830447.934484:0:6675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1788830447.934529:0:6675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1788830447.934590:0:6675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1788830447.934628:0:6675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1788830447.935766:0:6675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1788830447.935810:0:6675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1788830447.935846:0:6675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1788830447.935908:0:6675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1788830447.935947:0:6675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1788830447.935981:0:6675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1788830447.936030:0:6675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1788830447.936489:0:6675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1788830447.936535:0:6675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1788830447.936585:0:6675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1788830447.936621:0:6675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1788830447.936670:0:6675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1788830447.936795:0:6675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1788830447.936867:0:6675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1788830447.936918:0:6675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1788830447.936971:0:6675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1788830447.937006:0:6675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1788830447.937040:0:6675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1788830447.937244:0:6675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1788830447.937999:0:6675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:0.0:1788830447.938045:0:6675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:0.0:1788830447.938243:0:6675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:0.0:1788830447.938282:0:6675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:0.0:1788830447.938333:0:6675:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25479a0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1745cc3d-3952-4cd4-9020-9b8acb483105:6675:1875724595111680:0@lo:502: 00000100:00100000:0.0:1788830447.938688:0:6675:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830447.945167:0:6675:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e257fc23480 going to sleep for 11 seconds 00000100:00100000:3.0:1788830447.946761:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595111680 00000100:00100000:3.0:1788830447.946773:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595111680 00000100:00100000:3.0:1788830447.947869:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788830447.947881:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25747bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1745cc3d-3952-4cd4-9020-9b8acb483105+16:6675:x1875724595111680:12345-0@lo:502: 00000100:00100000:3.0:1788830447.948313:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25747bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1745cc3d-3952-4cd4-9020-9b8acb483105+16:6675:x1875724595111680:12345-0@lo:502: Request processed in 434us (9625us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830447.948319:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788830447.948399:0:6675:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25479a0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1745cc3d-3952-4cd4-9020-9b8acb483105:6675:1875724595111680:0@lo:502: 00000040:00080000:0.0:1788830447.948492:0:6675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:0.0:1788830447.948502:0:6675:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:0.0:1788830447.949371:0:6704:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1788830447.949385:0:6704:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9e2544830000) 00000020:00000080:0.0:1788830447.949459:0:6704:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lwp with refcount 2 00000020:01000004:0.0:1788830447.949541:0:6704:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e2565dcd800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788830447.949545:0:6704:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e2565dcd800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788830447.949548:0:6704:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e2565dcd800 3 00010000:00080000:0.0:1788830447.949577:0:6704:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e257fd60800@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.121@tcp at head 00010000:00010000:2.0:1788830447.956527:0:6704:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-3 is initialized 00000020:00000080:2.0:1788830447.956775:0:6704:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1788830447.956823:0:6704:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788830447.956837:0:6704:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x575506951eea0998 00000100:00080000:2.0:1788830447.956846:0:6704:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788830447.956852:0:6704:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9e257fd60800 using connection 192.168.201.121@tcp/0@lo 00000100:00100000:2.0:1788830447.956885:0:6704:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e2566013480 x1875724595111808/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788830447.956908:0:6704:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788830447.958312:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2566013480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3306:1875724595111808:0@lo:38: 00000100:00100000:0.0:1788830447.958385:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:2.0:1788830447.958678:0:6704:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:0.0:1788830447.958977:0:6675:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:0.0:1788830447.959004:0:6675:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.121@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788830447.959027:0:6675:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: ffff9e257d944800/0x575506951eea0983 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea098a expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830447.959039:0:6675:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.121@tcp lock: ffff9e257d944800/0x575506951eea0983 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea098a expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788830447.959155:0:6675:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788830447.959157:0:6675:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788830447.959158:0:6675:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788830447.959159:0:6675:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788830447.959160:0:6675:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788830447.959167:0:6675:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788830447.959168:0:6675:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788830447.959169:0:6675:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788830447.959171:0:6675:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788830447.959172:0:6675:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788830447.959173:0:6675:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788830447.959177:0:6675:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:0.0:1788830447.959179:0:6675:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788830447.959180:0:6675:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788830447.959181:0:6675:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788830447.959182:0:6675:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788830447.959182:0:6675:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788830447.959183:0:6675:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788830447.959184:0:6675:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788830447.959185:0:6675:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788830447.959185:0:6675:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788830447.959186:0:6675:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788830447.959187:0:6675:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788830447.959209:0:6675:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788830447.959223:0:6675:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25479a0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1745cc3d-3952-4cd4-9020-9b8acb483105:6675:1875724595111936:0@lo:253: 00000100:00100000:0.0:1788830447.959269:0:6675:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830447.959307:0:6675:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e257fc23a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788830447.959336:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595111936 00000100:00100000:2.0:1788830447.959344:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595111936 00000100:00100000:2.0:1788830447.959382:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788830447.959392:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25747bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1745cc3d-3952-4cd4-9020-9b8acb483105+16:6675:x1875724595111936:12345-0@lo:253: 20000000:01000000:2.0:1788830447.959418:0:5826:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788830447.959431:0:5826:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1788830447.959779:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595111808 00000100:00100000:3.0:1788830447.959785:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595111808 00000100:00100000:3.0:1788830447.959812:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788830447.959817:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25479a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3306:x1875724595111808:12345-0@lo:38: 00010000:00080000:3.0:1788830447.959837:0:5834:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 201 last 0 00000020:00000080:3.0:1788830447.959875:0:5834:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x575506951eea099f 00000004:00100000:3.0:1788830447.959890:0:5834:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788830447.959936:0:5834:0:(import.c:65:import_set_state_nolock()) ffff9e2444b5a800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788830447.959995:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25479a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875724595111808:12345-0@lo:38: Request processed in 176us (1609us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830447.960003:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788830447.960153:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9e2566013480 x1875724595111808/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788830457 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788830447.960163:0:3306:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788830447.960171:0:3306:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:3.0:1788830447.960179:0:3306:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788830447.960183:0:3306:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788830447.960185:0:3306:0:(import.c:65:import_set_state_nolock()) ffff9e257fd60800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788830447.960192:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2566013480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3306:1875724595111808:0@lo:38: 20000000:01000000:3.0:1788830448.013418:0:5826:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788830448.013452:0:5826:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1788830448.013470:0:5848:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788830448.013476:0:5848:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788830448.013497:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2540031200/0x575506951eea09a6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830448.013525:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e257d945800/0x575506951eea08c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x575506951eea08bf expref: 16 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830448.013533:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2540031200/0x575506951eea09a6 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830448.013576:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e257d945800/0x575506951eea08c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x575506951eea08bf expref: 16 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830448.013591:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e257d945800/0x575506951eea08c6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x575506951eea08bf expref: 16 pid: 5827 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788830448.013612:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25479a3b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5848:1875724595112064:0@lo:104: 00000100:00100000:0.0:1788830448.013693:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830448.013987:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e257fc23d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788830448.014063:0:5815:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788830448.014079:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595112064 00000100:00100000:1.0:1788830448.014086:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595112064 00000100:00100000:1.0:1788830448.014169:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788830448.014179:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25480b5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1745cc3d-3952-4cd4-9020-9b8acb483105+3:5848:x1875724595112064:12345-0@lo:104: 00010000:00010000:1.0:1788830448.014197:0:5815:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.121@tcp lock: ffff9e25820fea00/0x575506951eea08bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x575506951eea08c6 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830448.014264:0:5815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788830448.014270:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25480b5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1745cc3d-3952-4cd4-9020-9b8acb483105+3:5848:x1875724595112064:12345-0@lo:104: Request processed in 93us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830448.014278:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:3.0:1788830448.014347:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788830448.014356:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.121@tcp lock: ffff9e25820fea00/0x575506951eea08bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x575506951eea08c6 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830448.014366:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e25820fea00 already unused, calling callback (ffffffffc1aebc20) 10000000:00010000:3.0:1788830448.014371:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.121@tcp lock: ffff9e25820fea00/0x575506951eea08bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x575506951eea08c6 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830448.014379:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.121@tcp lock: ffff9e25820fea00/0x575506951eea08bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x575506951eea08c6 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788830448.014387:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.121@tcp lock: ffff9e25820fea00/0x575506951eea08bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x575506951eea08c6 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788830448.014393:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788830448.014429:0:5820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.121@tcp lock: ffff9e25820fea00/0x575506951eea08bf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x575506951eea08c6 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830448.014436:0:5820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788830448.014455:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.121@tcp lock: ffff9e25820fea00/0x575506951eea08bf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x575506951eea08c6 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830448.014462:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.121@tcp lock: ffff9e25820fea00/0x575506951eea08bf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x575506951eea08c6 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830448.014478:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788830448.014480:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788830448.014483:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788830448.014501:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788830448.014524:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257f807100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1745cc3d-3952-4cd4-9020-9b8acb483105:3309:1875724595112192:0@lo:103: 00000100:00100000:0.0:1788830448.014558:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788830448.014586:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595112192 00000100:00100000:2.0:1788830448.014591:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595112192 00010000:00010000:2.0:1788830448.014615:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e257d945800/0x575506951eea08c6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x575506951eea08bf expref: 17 pid: 5827 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788830448.014652:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788830448.014660:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2547437850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1745cc3d-3952-4cd4-9020-9b8acb483105+17:3309:x1875724595112192:12345-0@lo:103: 00010000:00010000:2.0:1788830448.014671:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788830448.014677:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e257d945800/0x575506951eea08c6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x575506951eea08bf expref: 17 pid: 5827 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830448.014689:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e257d945800/0x575506951eea08c6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x575506951eea08bf expref: 17 pid: 5827 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830448.014705:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2540031200/0x575506951eea09a6 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830448.014935:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e257d945800/0x575506951eea08c6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x575506951eea08bf expref: 17 pid: 5827 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788830448.014948:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25479a3b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5848:1875724595112064:0@lo:104: 00010000:00010000:2.0:1788830448.014964:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2540031200/0x575506951eea09a6 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830448.015013:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2540031200/0x575506951eea09a6 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788830448.015223:0:5819:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001747348s 00010000:00010000:2.0:1788830448.015229:0:5819:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2540031200/0x575506951eea09a6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830448.015237:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2540031200/0x575506951eea09a6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830448.015244:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2540031200/0x575506951eea09a6 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830448.015250:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2540031200/0x575506951eea09a6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830448.015256:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2540031200 already unused, calling callback (ffffffffc14cb350) 00010000:00010000:2.0:1788830448.015260:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2540031200/0x575506951eea09a6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830448.015268:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2540031200/0x575506951eea09a6 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830448.015286:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2540031200/0x575506951eea09a6 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830448.015296:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788830448.015305:0:5848:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2540031200/0x575506951eea09a6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830448.015314:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2540031200/0x575506951eea09a6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830448.015320:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2540031200/0x575506951eea09a6 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788830448.015382:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2547437850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1745cc3d-3952-4cd4-9020-9b8acb483105+16:3309:x1875724595112192:12345-0@lo:103: Request processed in 721us (821us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830448.015389:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788830448.015549:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257f807100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1745cc3d-3952-4cd4-9020-9b8acb483105:3309:1875724595112192:0@lo:103: 00000100:00100000:2.0:1788830448.028463:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25747bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1745cc3d-3952-4cd4-9020-9b8acb483105+15:6675:x1875724595111936:12345-0@lo:253: Request processed in 69063us (69185us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830448.028478:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788830448.028702:0:6675:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25479a0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1745cc3d-3952-4cd4-9020-9b8acb483105:6675:1875724595111936:0@lo:253: 10000000:01000000:3.0:1788830448.028773:0:6675:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788830448.028776:0:6675:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788830448.028778:0:6675:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788830448.028780:0:6675:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788830448.028781:0:6675:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788830448.028782:0:6675:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788830448.028783:0:6675:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788830448.028785:0:6675:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788830448.028786:0:6675:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788830448.028788:0:6675:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788830448.028789:0:6675:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788830448.028791:0:6675:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788830448.028807:0:6675:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1788830448.035466:0:6675:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1788830448.036549:0:6675:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1788830448.037145:0:6675:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1788830448.037337:0:6675:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1788830448.037560:0:6675:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1788830448.040051:0:6675:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1788830448.044655:0:6675:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1788830448.272375:0:6675:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1788830448.272383:0:6675:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1788830448.272414:0:6675:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788830448.272470:0:6675:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.121@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788830448.272483:0:6675:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1788830448.272581:0:6675:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:3.0:1788830448.672721:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788830449.691864:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788830450.716801:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788830451.739846:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788830452.773646:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788830453.470887:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788830453.470899:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788830453.470904:0:36:0:(import.c:65:import_set_state_nolock()) ffff9e2444adf000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788830453.470916:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 201 00000100:00080000:3.0:1788830453.470924:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788830453.470931:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9e2444adf000 using connection 192.168.201.121@tcp/0@lo 00000100:00100000:3.0:1788830453.470956:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e257f805f80 x1875724595112576/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788830453.471060:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257f805c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875724595112448:0@lo:400: 00000100:00100000:3.0:1788830453.471153:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830453.471228:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788830453.471235:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257f807100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1745cc3d-3952-4cd4-9020-9b8acb483105:3308:1875724595112320:0@lo:400: 00000100:00100000:3.0:1788830453.471261:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830453.471283:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257f805f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1875724595112576:0@lo:8: 00000100:00100000:3.0:1788830453.471309:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830453.471331:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257f804a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875724595112704:0@lo:400: 00000100:00100000:3.0:1788830453.471349:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830453.471381:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595112448 00000100:00100000:3.0:1788830453.471388:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595112448 00000100:00100000:3.0:1788830453.471790:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595112704 00000100:00100000:3.0:1788830453.471795:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595112704 00000100:00100000:3.0:1788830453.471830:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788830453.471840:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257f806d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875724595112448:12345-0@lo:400: 00000100:00100000:3.0:1788830453.471895:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257f806d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875724595112448:12345-0@lo:400: Request processed in 57us (742us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830453.471902:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788830453.471917:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788830453.471922:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257f805880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875724595112704:12345-0@lo:400: 00000100:00100000:3.0:1788830453.471945:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257f805880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875724595112704:12345-0@lo:400: Request processed in 23us (595us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830453.471951:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788830453.471989:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e257f804a80 x1875724595112704/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788830469 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788830453.472018:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257f804a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875724595112704:0@lo:400: 00010000:00080000:3.0:1788830453.472175:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e257f805c00 x1875724595112448/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788830469 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788830453.472185:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257f805c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875724595112448:0@lo:400: 00000100:00100000:3.0:1788830453.472219:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595112320 00000100:00100000:3.0:1788830453.472223:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595112320 00000100:00100000:3.0:1788830453.472289:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788830453.472296:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25747bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1745cc3d-3952-4cd4-9020-9b8acb483105+15:3308:x1875724595112320:12345-0@lo:400: 00000100:00100000:3.0:1788830453.472330:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25747bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1745cc3d-3952-4cd4-9020-9b8acb483105+15:3308:x1875724595112320:12345-0@lo:400: Request processed in 35us (1068us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830453.472337:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:0.0:1788830453.472412:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788830453.473252:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595112576 00000100:00100000:2.0:1788830453.473261:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595112576 00000100:00100000:2.0:1788830453.473291:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788830453.473297:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257f805180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3306:x1875724595112576:12345-0@lo:8: 00010000:00080000:2.0:1788830453.473321:0:6680:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 206 last 0 00000020:00000080:2.0:1788830453.473350:0:6680:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x575506951eea09ad 00002000:00100000:2.0:1788830453.473390:0:6680:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9e2444ad8800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113968 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1788830453.473395:0:6680:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:2.0:1788830453.473399:0:6680:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1788830453.473520:0:6680:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788830453.473930:0:6680:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788830453.473963:0:6680:0:(import.c:65:import_set_state_nolock()) ffff9e2444ad9000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788830453.474047:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257f805180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3306:x1875724595112576:12345-0@lo:8: Request processed in 748us (2735us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830453.474055:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788830453.474125:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e257f805f80 x1875724595112576/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788830468 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788830453.474136:0:3306:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788830453.474145:0:3306:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1788830453.474155:0:3306:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788830453.474161:0:3306:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1788830453.474165:0:3306:0:(import.c:65:import_set_state_nolock()) ffff9e2444adf000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788830453.474182:0:3306:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788830453.474188:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257f805f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1875724595112576:0@lo:8: 00000004:00080000:1.0:1788830453.475273:0:6696:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788830453.475700:0:6696:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 206822989064ns, next at 0ns, rc = 0 00000100:00100000:1.0:1788830453.478247:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257f807100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1745cc3d-3952-4cd4-9020-9b8acb483105:3308:1875724595112320:0@lo:400: 00000004:00080000:1.0:1788830453.541744:0:6697:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:1.0:1788830453.541780:0:6697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257e924700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6697:1875724595112960:0@lo:7: 00000100:00100000:1.0:1788830453.541857:0:6697:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830453.541914:0:6697:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2553723c00 going to sleep for 11 seconds 00000004:00080000:1.0:1788830453.541937:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:1.0:1788830453.541959:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257e926d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875724595112832:0@lo:13: 00000100:00100000:1.0:1788830453.541983:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830453.542032:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595112832 00000100:00100000:1.0:1788830453.542039:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595112832 00000100:00100000:1.0:1788830453.542090:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788830453.542099:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257e926680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1875724595112832:12345-0@lo:13: 00002000:00000024:1.0:1788830453.542128:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:1.0:1788830453.542170:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257e926680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1875724595112832:12345-0@lo:13: Request processed in 72us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830453.542178:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1788830453.542213:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788830453.542246:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e257e926d80 x1875724595112832/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788830469 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788830453.542268:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257e926d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875724595112832:0@lo:13: 00000100:00100000:3.0:1788830453.542725:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595112960 00000100:00100000:3.0:1788830453.542731:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595112960 00000100:00100000:3.0:1788830453.542773:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788830453.542781:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257e927800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6697:x1875724595112960:12345-0@lo:7: 00000001:00100000:1.0:1788830453.552077:0:6709:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00002000:00080000:3.0:1788830453.556077:0:6679:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:3.0:1788830453.556087:0:6679:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:3.0:1788830453.556205:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257e927800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:6697:x1875724595112960:12345-0@lo:7: Request processed in 13419us (14342us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830453.556217:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788830453.556383:0:6697:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e257e924700 x1875724595112960/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788830469 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788830453.556400:0:6697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257e924700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6697:1875724595112960:0@lo:7: 00000004:00080000:0.0:1788830453.556414:0:6697:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:0.0:1788830453.556457:0:6697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25479a3b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6697:1875724595113088:0@lo:5: 00000100:00100000:0.0:1788830453.556493:0:6697:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830453.556557:0:6697:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e25480640c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788830453.556598:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595113088 00000100:00100000:3.0:1788830453.556605:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595113088 00000100:00100000:3.0:1788830453.556659:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788830453.556669:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25479a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:6697:x1875724595113088:12345-0@lo:5: 00002000:00080000:3.0:1788830453.556697:0:6677:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1788830453.556742:0:6677:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:3.0:1788830453.557103:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25479a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:6697:x1875724595113088:12345-0@lo:5: Request processed in 435us (608us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1788830453.557111:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788830453.557142:0:6697:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e25479a3b80 x1875724595113088/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788830469 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788830453.557155:0:6697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25479a3b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6697:1875724595113088:0@lo:5: 00000004:00080000:0.0:1788830453.557166:0:6697:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:0.0:1788830453.557190:0:6697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25479a1500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6697:1875724595113216:0@lo:700: 00000100:00100000:0.0:1788830453.557216:0:6697:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830453.557241:0:6697:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e25480640c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788830453.557343:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595113216 00000100:00100000:3.0:1788830453.557348:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595113216 00000100:00100000:3.0:1788830453.557375:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788830453.557383:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25479a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+6:6697:x1875724595113216:12345-0@lo:700: 00000100:00100000:3.0:1788830453.557427:0:6686:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257f805c00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6686:1875724595113344:0@lo:700: 00000100:00100000:3.0:1788830453.557462:0:6686:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830453.557487:0:6686:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e24452d86c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788830453.557506:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595113344 00000100:00100000:1.0:1788830453.557512:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595113344 00000100:00100000:1.0:1788830453.557558:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788830453.557565:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257f804a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6686:x1875724595113344:12345-0@lo:700: 40000000:02000000:1.0:1788830453.620545:0:5839:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:1.0:1788830453.624869:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257f804a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6686:x1875724595113344:12345-0@lo:700: Request processed in 67294us (67396us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830453.624883:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788830453.624945:0:6686:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e257f805c00 x1875724595113344/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788830469 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788830453.624960:0:6686:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257f805c00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6686:1875724595113344:0@lo:700: 40000000:02000000:1.0:1788830453.624972:0:6686:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000100:00100000:1.0:1788830453.700111:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25479a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+6:6697:x1875724595113216:12345-0@lo:700: Request processed in 142713us (142879us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830453.700132:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000001:00080000:1.0:1788830453.700180:0:6709:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00010000:00080000:1.0:1788830453.700229:0:6697:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e25479a1500 x1875724595113216/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788830469 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788830453.700246:0:6697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25479a1500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6697:1875724595113216:0@lo:700: 00000004:02000040:1.0:1788830453.743564:0:6697:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:1.0:1788830453.756703:0:6697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257e926d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6697:1875724595113472:0@lo:5: 00000100:00100000:1.0:1788830453.756826:0:6697:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830453.756893:0:6697:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2553723f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788830453.757126:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595113472 00000100:00100000:1.0:1788830453.757135:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595113472 00000100:00100000:1.0:1788830453.757206:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788830453.757218:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257e924000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:6697:x1875724595113472:12345-0@lo:5: 00002000:00080000:1.0:1788830453.761865:0:6679:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:1.0:1788830453.761888:0:6679:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:1.0:1788830453.767241:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257e924000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6697:x1875724595113472:12345-0@lo:5: Request processed in 10019us (10409us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1788830453.767254:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1788830453.767385:0:6697:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e257e926d80 x1875724595113472/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788830469 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788830453.767399:0:6697:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1788830453.767413:0:6697:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9e257e926d80 x1875724595113472/t4294967298(4294967298) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788830469 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788830453.767424:0:6697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257e926d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6697:1875724595113472:0@lo:5: 00000004:00080000:3.0:1788830453.767439:0:6697:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:2.0:1788830453.788830:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788830454.005286:0:7050:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg121-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788830454.814526:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788830455.839772:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788830456.539771:0:5829:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788830456.539778:0:5829:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9e255d9b0800 from 4 10000000:01000000:0.0:1788830456.539782:0:5829:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788830456.539828:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.121@tcp lock: ffff9e2540030600/0x575506951eea09b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830456.539840:0:5829:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.121@tcp lock: ffff9e2540030600/0x575506951eea09b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830456.539851:0:5829:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.121@tcp lock: ffff9e2540030600/0x575506951eea09b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788830456.539875:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25479a0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1745cc3d-3952-4cd4-9020-9b8acb483105:5829:1875724595113600:0@lo:101: 00000100:00100000:0.0:1788830456.539945:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830456.539993:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e257fbd6480 going to sleep for 11 seconds 00000100:00100000:1.0:1788830456.542068:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595113600 00000100:00100000:1.0:1788830456.542080:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595113600 00000100:00100000:1.0:1788830456.542135:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788830456.542146:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25747bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1745cc3d-3952-4cd4-9020-9b8acb483105+15:5829:x1875724595113600:12345-0@lo:101: 00010000:00010000:1.0:1788830456.542162:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788830456.542191:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e25820ff800/0x575506951eea09bb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x575506951eea09b4 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830456.542218:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e25820ff800/0x575506951eea09bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x575506951eea09b4 expref: 16 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830456.542230:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e25820ff800/0x575506951eea09bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x575506951eea09b4 expref: 16 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830456.542239:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e25820ff800, rc 0) 00000100:00100000:1.0:1788830456.542315:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25747bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1745cc3d-3952-4cd4-9020-9b8acb483105+16:5829:x1875724595113600:12345-0@lo:101: Request processed in 170us (2369us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830456.542333:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788830456.542399:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25479a0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1745cc3d-3952-4cd4-9020-9b8acb483105:5829:1875724595113600:0@lo:101: 00010000:00010000:1.0:1788830456.542415:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.121@tcp lock: ffff9e2540030600/0x575506951eea09b4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea09bb expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830456.542425:0:5829:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.121@tcp lock: ffff9e2540030600/0x575506951eea09b4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x575506951eea09bb expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788830456.542483:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257e927100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1745cc3d-3952-4cd4-9020-9b8acb483105:5829:1875724595113728:0@lo:256: 00000100:00100000:1.0:1788830456.542532:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830456.542572:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2553723c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788830456.542596:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595113728 00000100:00100000:1.0:1788830456.542599:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595113728 00000100:00100000:1.0:1788830456.542623:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788830456.542629:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e254812d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1745cc3d-3952-4cd4-9020-9b8acb483105+16:5829:x1875724595113728:12345-0@lo:256: 20000000:01000000:1.0:1788830456.542642:0:5827:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788830456.542657:0:5827:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788830456.542660:0:5827:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:1.0:1788830456.542758:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e254812d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1745cc3d-3952-4cd4-9020-9b8acb483105+16:5829:x1875724595113728:12345-0@lo:256: Request processed in 128us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830456.542764:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788830456.542791:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257e927100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1745cc3d-3952-4cd4-9020-9b8acb483105:5829:1875724595113728:0@lo:256: 10000000:01000000:1.0:1788830456.542843:0:5829:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.121@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788830456.542850:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: ffff9e2540030600/0x575506951eea09b4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea09bb expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830456.542857:0:5829:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.121@tcp lock: ffff9e2540030600/0x575506951eea09b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea09bb expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830456.859894:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788830457.884991:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788830458.375071:0:6709:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00000100:00100000:1.0:1788830458.588624:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25479a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875724595113856:0@lo:13: 00000100:00100000:1.0:1788830458.588700:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830458.588846:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595113856 00000100:00100000:0.0:1788830458.588858:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595113856 00000100:00100000:0.0:1788830458.588912:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788830458.588921:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257e927100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875724595113856:12345-0@lo:13: 00002000:00000024:0.0:1788830458.588952:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788830458.588997:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257e927100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875724595113856:12345-0@lo:13: Request processed in 77us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830458.589003:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1788830458.589059:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788830458.589090:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e25479a1f80 x1875724595113856/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788830474 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788830458.589100:0:3307:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1788830458.589125:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25479a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875724595113856:0@lo:13: 00000100:00100000:0.0:1788830458.589402:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788830458.589412:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2566010a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1745cc3d-3952-4cd4-9020-9b8acb483105:3307:1875724595113984:0@lo:400: 00000100:00100000:0.0:1788830458.589441:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830458.589516:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595113984 00000100:00100000:1.0:1788830458.589521:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595113984 00000100:00100000:1.0:1788830458.589553:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788830458.589560:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e254812d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+16:3307:x1875724595113984:12345-0@lo:400: 00000100:00100000:1.0:1788830458.589593:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e254812d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+16:3307:x1875724595113984:12345-0@lo:400: Request processed in 34us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830458.589599:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788830458.589628:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2566010a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1745cc3d-3952-4cd4-9020-9b8acb483105:3307:1875724595113984:0@lo:400: 00000100:00100000:2.0:1788830458.589723:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2566012a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875724595114112:0@lo:400: 00000100:00100000:2.0:1788830458.589754:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788830458.589778:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788830458.589783:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2566012d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875724595114240:0@lo:400: 00000100:00100000:2.0:1788830458.589821:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830458.589892:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595114112 00000100:00100000:0.0:1788830458.589896:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595114112 00000100:00100000:0.0:1788830458.589928:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595114240 00000100:00100000:0.0:1788830458.589931:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595114240 00000100:00100000:0.0:1788830458.589950:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788830458.589955:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2566013800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875724595114112:12345-0@lo:400: 00000100:00100000:0.0:1788830458.589987:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2566013800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875724595114112:12345-0@lo:400: Request processed in 31us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830458.589993:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788830458.590002:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788830458.590007:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2566010700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875724595114240:12345-0@lo:400: 00000100:00100000:0.0:1788830458.590026:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2566010700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875724595114240:12345-0@lo:400: Request processed in 19us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830458.590031:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1788830458.590092:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788830458.590156:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e2566012d80 x1875724595114240/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788830474 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788830458.590166:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2566012d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875724595114240:0@lo:400: 00010000:00080000:2.0:1788830458.590174:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e2566012a00 x1875724595114112/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788830474 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788830458.590181:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2566012a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875724595114112:0@lo:400: 00010000:00010000:0.0:1788830458.914034:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788830459.932036:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788830460.955887:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788830461.981069:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788830463.004033:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788830463.708886:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2566011880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875724595114624:0@lo:400: 00000100:00100000:2.0:1788830463.708986:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830463.708989:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2566012a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1745cc3d-3952-4cd4-9020-9b8acb483105:3307:1875724595114368:0@lo:400: 00000100:00100000:1.0:1788830463.709028:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830463.709052:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25479a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875724595114880:0@lo:13: 00000100:00100000:2.0:1788830463.709071:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788830463.709075:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788830463.709077:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2566011180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875724595114752:0@lo:400: 00000100:00100000:1.0:1788830463.709101:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788830463.709102:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830463.709106:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2566012d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875724595114496:0@lo:400: 00000100:00100000:1.0:1788830463.709126:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788830463.709155:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595114752 00000100:00100000:1.0:1788830463.709157:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595114368 00000100:00100000:2.0:1788830463.709162:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595114752 00000100:00100000:1.0:1788830463.709162:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595114368 00000100:00100000:2.0:1788830463.709206:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595114496 00000100:00100000:2.0:1788830463.709208:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595114496 00000100:00100000:1.0:1788830463.709210:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788830463.709219:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e254812f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1745cc3d-3952-4cd4-9020-9b8acb483105+16:3307:x1875724595114368:12345-0@lo:400: 00000100:00100000:2.0:1788830463.709221:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788830463.709226:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2566010380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875724595114752:12345-0@lo:400: 00000100:00100000:2.0:1788830463.709268:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2566010380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875724595114752:12345-0@lo:400: Request processed in 41us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830463.709268:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e254812f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1745cc3d-3952-4cd4-9020-9b8acb483105+16:3307:x1875724595114368:12345-0@lo:400: Request processed in 49us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830463.709276:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788830463.709276:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788830463.709293:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00080000:1.0:1788830463.709305:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788830463.709311:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257e924380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875724595114496:12345-0@lo:400: 00000100:00100000:1.0:1788830463.709336:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2566012a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1745cc3d-3952-4cd4-9020-9b8acb483105:3307:1875724595114368:0@lo:400: 00000100:00100000:2.0:1788830463.709343:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257e924380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875724595114496:12345-0@lo:400: Request processed in 34us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830463.709348:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1788830463.709360:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e2566012d80 x1875724595114496/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788830479 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788830463.709383:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2566012d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875724595114496:0@lo:400: 00010000:00080000:2.0:1788830463.709386:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e2566011180 x1875724595114752/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788830479 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788830463.709395:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2566011180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875724595114752:0@lo:400: 00000100:00100000:0.0:1788830463.709502:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595114624 00000100:00100000:0.0:1788830463.709508:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595114624 00000100:00100000:0.0:1788830463.709555:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788830463.709563:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2566013100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875724595114624:12345-0@lo:400: 00000100:00100000:0.0:1788830463.709605:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2566013100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875724595114624:12345-0@lo:400: Request processed in 44us (619us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830463.709611:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788830463.709631:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595114880 00000100:00100000:0.0:1788830463.709634:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595114880 00000100:00100000:0.0:1788830463.709657:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788830463.709663:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257e926d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875724595114880:12345-0@lo:13: 00010000:00080000:2.0:1788830463.709682:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e2566011880 x1875724595114624/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788830479 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00002000:00000024:0.0:1788830463.709688:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788830463.709691:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2566011880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875724595114624:0@lo:400: 00000100:00100000:0.0:1788830463.709753:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257e926d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875724595114880:12345-0@lo:13: Request processed in 89us (676us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830463.709759:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1788830463.709825:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788830463.709902:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e25479a3480 x1875724595114880/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788830479 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788830463.709916:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25479a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875724595114880:0@lo:13: 00010000:00010000:3.0:1788830464.030540:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788830464.136929:0:7625:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788830464.136935:0:7625:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:1.0:1788830464.137095:0:7625:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9e2444ab0800 00000020:01000004:1.0:1788830464.137112:0:7625:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1788830464.137126:0:7625:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:1.0:1788830464.137141:0:7625:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9e25474f0000) 00000020:00000080:1.0:1788830464.137161:0:7625:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1788830464.150158:0:7625:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:0.0:1788830464.150530:0:7625:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:0.0:1788830464.169183:0:7625:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:0.0:1788830464.176673:0:7625:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1788830464.176748:0:7625:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:0.0:1788830464.176811:0:7625:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1788830464.176842:0:7625:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:0.0:1788830464.177307:0:7625:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:0.0:1788830464.177319:0:7625:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788830464.177332:0:7625:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x575506951eea09c9 00000020:01000004:0.0:1788830464.177348:0:7625:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:0.0:1788830464.177383:0:7625:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.121@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1788830464.177387:0:7625:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.121@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1788830464.177516:0:7625:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:0.0:1788830464.177539:0:7625:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:0.0:1788830464.177543:0:7625:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.121@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1788830464.198036:0:7625:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.121@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788830464.198080:0:7625:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.121@tcp, index=0001, flags=0x20062 00000020:01000004:2.0:1788830464.198085:0:7625:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788830464.198087:0:7625:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788830464.198088:0:7625:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788830464.198089:0:7625:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788830464.198090:0:7625:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788830464.198091:0:7625:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788830464.198093:0:7625:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788830464.198094:0:7625:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788830464.198099:0:7625:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788830464.198101:0:7625:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788830464.198102:0:7625:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788830464.198105:0:7625:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:2.0:1788830464.198107:0:7625:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788830464.198109:0:7625:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788830464.198110:0:7625:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788830464.198110:0:7625:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788830464.198111:0:7625:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788830464.198112:0:7625:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788830464.198113:0:7625:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788830464.198114:0:7625:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788830464.198115:0:7625:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788830464.198116:0:7625:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788830464.198117:0:7625:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788830464.198144:0:7625:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788830464.198165:0:7625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2566011880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1745cc3d-3952-4cd4-9020-9b8acb483105:7625:1875724595115008:0@lo:253: 00000100:00100000:2.0:1788830464.198322:0:7625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788830464.198553:0:7625:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2544e41180 going to sleep for 11 seconds 00000100:00100000:0.0:1788830464.198658:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595115008 00000100:00100000:0.0:1788830464.198667:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595115008 00000100:00100000:1.0:1788830464.198937:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788830464.198951:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255d99b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1745cc3d-3952-4cd4-9020-9b8acb483105+16:7625:x1875724595115008:12345-0@lo:253: 20000000:01000000:1.0:1788830464.198986:0:5826:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1788830464.198991:0:5826:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:1.0:1788830464.198996:0:5826:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:1.0:1788830464.199008:0:5826:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:1.0:1788830464.200146:0:5826:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788830464.200768:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:1.0:1788830464.200785:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:1.0:1788830464.200828:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:1.0:1788830464.200837:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:1.0:1788830464.200867:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:1.0:1788830464.200916:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:1.0:1788830464.201523:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:1.0:1788830464.201547:0:5826:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.121@tcp 20000000:01000000:1.0:1788830464.201549:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.121@tcp (null) (null) (null) 00000040:00080000:1.0:1788830464.201587:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:1.0:1788830464.201595:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788830464.201644:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:1.0:1788830464.201653:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.201.121@tcp (null) (null) 00000040:00080000:1.0:1788830464.201685:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:1.0:1788830464.201695:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1788830464.205468:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:1.0:1788830464.205584:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:1.0:1788830464.208028:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:1.0:1788830464.208062:0:5826:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.121@tcp 20000000:01000000:1.0:1788830464.208065:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.121@tcp (null) (null) (null) 00000040:00080000:1.0:1788830464.208103:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:1.0:1788830464.208112:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1788830464.208142:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:1.0:1788830464.208151:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.201.121@tcp (null) (null) 00000040:00080000:1.0:1788830464.208184:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:1.0:1788830464.208194:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1788830464.208890:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:1.0:1788830464.208948:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:1.0:1788830464.208967:0:5826:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:1.0:1788830464.208978:0:5826:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1788830464.208982:0:5826:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1788830464.208996:0:5826:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788830464.208998:0:5826:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1788830464.209042:0:5826:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1788830464.209045:0:5826:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788830464.209852:0:7627:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 14 1->4: lustre sys.timeout 20000000:01000000:2.0:1788830464.209913:0:7627:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 14 2->4: lustre sys.timeout 00000040:00080000:2.0:1788830464.209969:0:7627:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:1.0:1788830464.210222:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:1.0:1788830464.210277:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:1.0:1788830464.210353:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:1.0:1788830464.210380:0:5826:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1788830464.210382:0:5826:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:2.0:1788830464.210848:0:7628:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:1.0:1788830464.211037:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:1.0:1788830464.211074:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:1.0:1788830464.211131:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:1.0:1788830464.211141:0:5826:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1788830464.211144:0:5826:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788830464.215551:0:7629:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 15 1->4: lustre sys.timeout 20000000:01000000:2.0:1788830464.215644:0:7629:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 15 2->4: lustre sys.timeout 00000040:00080000:2.0:1788830464.215756:0:7629:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:1.0:1788830464.216309:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:1.0:1788830464.216369:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:1.0:1788830464.216422:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:1.0:1788830464.216436:0:5826:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1788830464.216439:0:5826:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788830464.218198:0:7630:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 16 1->4: lustre sys.timeout 20000000:01000000:2.0:1788830464.218314:0:7630:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 16 2->4: lustre sys.timeout 00000040:00080000:2.0:1788830464.218350:0:7630:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:1.0:1788830464.218792:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:1.0:1788830464.218842:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:1.0:1788830464.218897:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:1.0:1788830464.218916:0:5826:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:1.0:1788830464.218919:0:5826:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:1.0:1788830464.218929:0:5826:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1788830464.218952:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e25820fe200/0x575506951eea09d0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830464.218974:0:5826:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e25820fe800/0x575506951eea08f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x575506951eea08f0 expref: 16 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830464.218981:0:5826:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e257d80e600/0x575506951eea0905 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x575506951eea08fe expref: 16 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830464.219007:0:5826:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2540030a00/0x575506951eea093d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x575506951eea0936 expref: 16 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830464.219014:0:5826:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2540031c00/0x575506951eea096e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x575506951eea0967 expref: 16 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830464.219021:0:5826:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e25820fe600/0x575506951eea098a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x575506951eea0983 expref: 16 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830464.219028:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e25820fe200/0x575506951eea09d0 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830464.219069:0:5826:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e25820fe600/0x575506951eea098a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x575506951eea0983 expref: 16 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830464.219086:0:5826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e25820fe600/0x575506951eea098a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x575506951eea0983 expref: 16 pid: 5827 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788830464.219101:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257e925880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5826:1875724595115136:0@lo:104: 00000100:00100000:1.0:1788830464.219165:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788830464.219220:0:5826:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2540031c00/0x575506951eea096e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x575506951eea0967 expref: 16 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830464.219227:0:5826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e2540031c00/0x575506951eea096e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x575506951eea0967 expref: 16 pid: 5824 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788830464.219250:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257e924a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5826:1875724595115264:0@lo:104: 00000100:00100000:1.0:1788830464.219272:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788830464.219305:0:5826:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2540030a00/0x575506951eea093d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x575506951eea0936 expref: 16 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830464.219319:0:5826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e2540030a00/0x575506951eea093d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x575506951eea0936 expref: 16 pid: 5824 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788830464.219327:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257e925f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5826:1875724595115392:0@lo:104: 00000100:00100000:1.0:1788830464.219349:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788830464.219377:0:5826:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e257d80e600/0x575506951eea0905 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x575506951eea08fe expref: 16 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830464.219385:0:5826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e257d80e600/0x575506951eea0905 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x575506951eea08fe expref: 16 pid: 5826 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788830464.219392:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257e924700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5826:1875724595115520:0@lo:104: 00000100:00100000:1.0:1788830464.219412:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788830464.219429:0:5826:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e25820fe800/0x575506951eea08f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x575506951eea08f0 expref: 16 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830464.219436:0:5826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e25820fe800/0x575506951eea08f7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x575506951eea08f0 expref: 16 pid: 5826 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788830464.219443:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257e925c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5826:1875724595115648:0@lo:104: 00000100:00100000:1.0:1788830464.219460:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830464.219470:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2544f87a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788830464.219637:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595115136 00000100:00100000:2.0:1788830464.219646:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595115136 00000100:00100000:2.0:1788830464.219681:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595115264 00000100:00100000:2.0:1788830464.219684:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595115264 00000100:00100000:2.0:1788830464.219692:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595115392 00000100:00100000:2.0:1788830464.219694:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595115392 00000100:00100000:2.0:1788830464.219729:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595115520 00000100:00100000:2.0:1788830464.219732:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595115520 00000100:00100000:2.0:1788830464.219741:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595115648 00000100:00100000:2.0:1788830464.219743:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595115648 00000100:00100000:2.0:1788830464.219756:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788830464.219765:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257e926a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1745cc3d-3952-4cd4-9020-9b8acb483105+7:5826:x1875724595115136:12345-0@lo:104: 00010000:00010000:2.0:1788830464.219779:0:5815:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.121@tcp lock: ffff9e257d944800/0x575506951eea0983 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x575506951eea098a expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830464.219849:0:5815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788830464.219855:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257e926a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1745cc3d-3952-4cd4-9020-9b8acb483105+7:5826:x1875724595115136:12345-0@lo:104: Request processed in 91us (690us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830464.219862:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788830464.219880:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788830464.219887:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257e927480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1745cc3d-3952-4cd4-9020-9b8acb483105+6:5826:x1875724595115264:12345-0@lo:104: 00010000:00010000:2.0:1788830464.219894:0:5815:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.121@tcp lock: ffff9e257d945200/0x575506951eea0967 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x575506951eea096e expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830464.219923:0:5815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788830464.219929:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257e927480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1745cc3d-3952-4cd4-9020-9b8acb483105+6:5826:x1875724595115264:12345-0@lo:104: Request processed in 43us (656us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830464.219934:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788830464.219946:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788830464.219951:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257e924e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1745cc3d-3952-4cd4-9020-9b8acb483105+5:5826:x1875724595115392:12345-0@lo:104: 00010000:00010000:2.0:1788830464.219957:0:5815:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.121@tcp lock: ffff9e257d944000/0x575506951eea0936 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x575506951eea093d expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830464.219983:0:5815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788830464.219995:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257e924e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1745cc3d-3952-4cd4-9020-9b8acb483105+5:5826:x1875724595115392:12345-0@lo:104: Request processed in 43us (645us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830464.220000:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788830464.220011:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788830464.220016:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257e927b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1745cc3d-3952-4cd4-9020-9b8acb483105+4:5826:x1875724595115520:12345-0@lo:104: 00010000:00010000:2.0:1788830464.220023:0:5815:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.121@tcp lock: ffff9e25820ff400/0x575506951eea08fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x575506951eea0905 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830464.220049:0:5815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1788830464.220054:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257e927b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1745cc3d-3952-4cd4-9020-9b8acb483105+4:5826:x1875724595115520:12345-0@lo:104: Request processed in 39us (642us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830464.220059:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788830464.220071:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788830464.220077:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257e925500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1745cc3d-3952-4cd4-9020-9b8acb483105+3:5826:x1875724595115648:12345-0@lo:104: 00010000:00010000:2.0:1788830464.220083:0:5815:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.121@tcp lock: ffff9e25820ff200/0x575506951eea08f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x575506951eea08f7 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830464.220107:0:5815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1788830464.220112:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257e925500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1745cc3d-3952-4cd4-9020-9b8acb483105+3:5826:x1875724595115648:12345-0@lo:104: Request processed in 37us (652us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830464.220118:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:3.0:1788830464.220536:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1788830464.220545:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.121@tcp lock: ffff9e257d944800/0x575506951eea0983 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x575506951eea098a expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830464.220554:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e257d944800 already unused, calling callback (ffffffffc1aebc20) 10000000:00010000:3.0:1788830464.220559:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.121@tcp lock: ffff9e257d944800/0x575506951eea0983 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x575506951eea098a expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830464.220569:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.121@tcp lock: ffff9e257d944800/0x575506951eea0983 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x575506951eea098a expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788830464.220586:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.121@tcp lock: ffff9e257d944800/0x575506951eea0983 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x575506951eea098a expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788830464.220593:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788830464.220635:0:5820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.121@tcp lock: ffff9e257d944800/0x575506951eea0983 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x575506951eea098a expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830464.220642:0:5820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788830464.220662:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.121@tcp lock: ffff9e257d944800/0x575506951eea0983 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x575506951eea098a expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830464.220670:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.121@tcp lock: ffff9e257d944800/0x575506951eea0983 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x575506951eea098a expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830464.220693:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788830464.220696:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.121@tcp lock: ffff9e257d945200/0x575506951eea0967 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x575506951eea096e expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830464.220702:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e257d945200 already unused, calling callback (ffffffffc1aebc20) 10000000:00010000:3.0:1788830464.220704:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.121@tcp lock: ffff9e257d945200/0x575506951eea0967 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x575506951eea096e expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830464.220734:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.121@tcp lock: ffff9e257d945200/0x575506951eea0967 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x575506951eea096e expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788830464.220741:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.121@tcp lock: ffff9e257d945200/0x575506951eea0967 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x575506951eea096e expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788830464.220746:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788830464.220768:0:5820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.121@tcp lock: ffff9e257d945200/0x575506951eea0967 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x575506951eea096e expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830464.220773:0:5820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788830464.220788:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.121@tcp lock: ffff9e257d945200/0x575506951eea0967 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x575506951eea096e expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830464.220794:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.121@tcp lock: ffff9e257d945200/0x575506951eea0967 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x575506951eea096e expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830464.220805:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788830464.220808:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.121@tcp lock: ffff9e257d944000/0x575506951eea0936 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x575506951eea093d expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830464.220814:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e257d944000 already unused, calling callback (ffffffffc1aebc20) 10000000:00010000:3.0:1788830464.220816:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.121@tcp lock: ffff9e257d944000/0x575506951eea0936 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x575506951eea093d expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830464.220823:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.121@tcp lock: ffff9e257d944000/0x575506951eea0936 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x575506951eea093d expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788830464.220829:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.121@tcp lock: ffff9e257d944000/0x575506951eea0936 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x575506951eea093d expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788830464.220835:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788830464.220847:0:5820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.121@tcp lock: ffff9e257d944000/0x575506951eea0936 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x575506951eea093d expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830464.220853:0:5820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788830464.220858:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.121@tcp lock: ffff9e257d944000/0x575506951eea0936 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x575506951eea093d expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830464.220873:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.121@tcp lock: ffff9e257d944000/0x575506951eea0936 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x575506951eea093d expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830464.220883:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788830464.220886:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.121@tcp lock: ffff9e25820ff400/0x575506951eea08fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x575506951eea0905 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830464.220892:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e25820ff400 already unused, calling callback (ffffffffc1aebc20) 10000000:00010000:3.0:1788830464.220895:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.121@tcp lock: ffff9e25820ff400/0x575506951eea08fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x575506951eea0905 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830464.220902:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.121@tcp lock: ffff9e25820ff400/0x575506951eea08fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x575506951eea0905 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788830464.220908:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.121@tcp lock: ffff9e25820ff400/0x575506951eea08fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x575506951eea0905 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788830464.220913:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788830464.220926:0:5820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.121@tcp lock: ffff9e25820ff400/0x575506951eea08fe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x575506951eea0905 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830464.220933:0:5820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788830464.220938:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.121@tcp lock: ffff9e25820ff400/0x575506951eea08fe lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x575506951eea0905 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830464.220945:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.121@tcp lock: ffff9e25820ff400/0x575506951eea08fe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x575506951eea0905 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830464.220953:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788830464.220964:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.121@tcp lock: ffff9e25820ff200/0x575506951eea08f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x575506951eea08f7 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830464.220968:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e25820ff200 already unused, calling callback (ffffffffc1aebc20) 10000000:00010000:3.0:1788830464.220971:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.121@tcp lock: ffff9e25820ff200/0x575506951eea08f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x575506951eea08f7 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830464.220978:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.121@tcp lock: ffff9e25820ff200/0x575506951eea08f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x575506951eea08f7 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788830464.220984:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.121@tcp lock: ffff9e25820ff200/0x575506951eea08f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x575506951eea08f7 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788830464.220988:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788830464.221001:0:5820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.121@tcp lock: ffff9e25820ff200/0x575506951eea08f0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x575506951eea08f7 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830464.221007:0:5820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788830464.221011:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.121@tcp lock: ffff9e25820ff200/0x575506951eea08f0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x575506951eea08f7 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830464.221017:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.121@tcp lock: ffff9e25820ff200/0x575506951eea08f0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x575506951eea08f7 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830464.221031:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788830464.221033:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788830464.221035:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788830464.221061:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257f804700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1745cc3d-3952-4cd4-9020-9b8acb483105:3308:1875724595115776:0@lo:103: 00000100:00100000:3.0:1788830464.221100:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830464.221137:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257f806680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1745cc3d-3952-4cd4-9020-9b8acb483105:3308:1875724595116288:0@lo:103: 00000100:00100000:3.0:1788830464.221170:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830464.221191:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788830464.221197:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257f807480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1745cc3d-3952-4cd4-9020-9b8acb483105:3308:1875724595116160:0@lo:103: 00000100:00100000:3.0:1788830464.221216:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830464.221368:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257f807800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1745cc3d-3952-4cd4-9020-9b8acb483105:3309:1875724595115904:0@lo:103: 00000100:00100000:3.0:1788830464.221391:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830464.222381:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788830464.222394:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257f804e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1745cc3d-3952-4cd4-9020-9b8acb483105:3309:1875724595116032:0@lo:103: 00000100:00100000:3.0:1788830464.222542:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830464.222588:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595115776 00000100:00100000:3.0:1788830464.222596:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595115776 00010000:00010000:3.0:1788830464.222625:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e25820fe600/0x575506951eea098a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x575506951eea0983 expref: 17 pid: 5827 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788830464.222645:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595116288 00000100:00100000:3.0:1788830464.222648:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595116288 00010000:00010000:3.0:1788830464.222659:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e25820fe800/0x575506951eea08f7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x575506951eea08f0 expref: 18 pid: 5826 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788830464.222671:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595116160 00000100:00100000:3.0:1788830464.222673:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595116160 00010000:00010000:3.0:1788830464.222683:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e257d80e600/0x575506951eea0905 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x575506951eea08fe expref: 19 pid: 5826 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788830464.222691:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595115904 00000100:00100000:3.0:1788830464.222694:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595115904 00010000:00010000:3.0:1788830464.222703:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2540031c00/0x575506951eea096e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x575506951eea0967 expref: 20 pid: 5824 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788830464.222730:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595116032 00000100:00100000:3.0:1788830464.222744:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595116032 00010000:00010000:3.0:1788830464.222758:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2540030a00/0x575506951eea093d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x575506951eea0936 expref: 21 pid: 5824 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788830464.222773:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788830464.222780:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257f806a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1745cc3d-3952-4cd4-9020-9b8acb483105+21:3308:x1875724595115776:12345-0@lo:103: 00010000:00010000:3.0:1788830464.222793:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788830464.222799:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e25820fe600/0x575506951eea098a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x575506951eea0983 expref: 21 pid: 5827 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830464.222811:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e25820fe600/0x575506951eea098a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x575506951eea0983 expref: 21 pid: 5827 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830464.222831:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788830464.222872:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257f806a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1745cc3d-3952-4cd4-9020-9b8acb483105+21:3308:x1875724595115776:12345-0@lo:103: Request processed in 91us (1770us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830464.222878:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788830464.222896:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788830464.222902:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257f807b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1745cc3d-3952-4cd4-9020-9b8acb483105+20:3308:x1875724595116288:12345-0@lo:103: 00010000:00010000:3.0:1788830464.222909:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788830464.222914:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e25820fe800/0x575506951eea08f7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x575506951eea08f0 expref: 20 pid: 5826 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830464.222922:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e25820fe800/0x575506951eea08f7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x575506951eea08f0 expref: 20 pid: 5826 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830464.222931:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788830464.222953:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257f807b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1745cc3d-3952-4cd4-9020-9b8acb483105+20:3308:x1875724595116288:12345-0@lo:103: Request processed in 51us (1782us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830464.222958:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788830464.222974:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788830464.222979:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257f804000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1745cc3d-3952-4cd4-9020-9b8acb483105+19:3308:x1875724595116160:12345-0@lo:103: 00010000:00010000:3.0:1788830464.222986:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788830464.222990:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e257d80e600/0x575506951eea0905 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x575506951eea08fe expref: 19 pid: 5826 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830464.222997:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e257d80e600/0x575506951eea0905 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x575506951eea08fe expref: 19 pid: 5826 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830464.223005:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788830464.223025:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257f804000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1745cc3d-3952-4cd4-9020-9b8acb483105+19:3308:x1875724595116160:12345-0@lo:103: Request processed in 45us (1808us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830464.223030:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788830464.223041:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788830464.223047:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257f804380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1745cc3d-3952-4cd4-9020-9b8acb483105+18:3309:x1875724595115904:12345-0@lo:103: 00010000:00010000:3.0:1788830464.223056:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788830464.223060:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2540031c00/0x575506951eea096e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x575506951eea0967 expref: 18 pid: 5824 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830464.223069:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2540031c00/0x575506951eea096e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x575506951eea0967 expref: 18 pid: 5824 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830464.223078:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788830464.223106:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257f804380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1745cc3d-3952-4cd4-9020-9b8acb483105+18:3309:x1875724595115904:12345-0@lo:103: Request processed in 59us (1713us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830464.223112:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788830464.223123:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788830464.223128:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257f805c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1745cc3d-3952-4cd4-9020-9b8acb483105+17:3309:x1875724595116032:12345-0@lo:103: 00010000:00010000:3.0:1788830464.223135:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788830464.223145:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2540030a00/0x575506951eea093d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x575506951eea0936 expref: 17 pid: 5824 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830464.223154:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2540030a00/0x575506951eea093d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x575506951eea0936 expref: 17 pid: 5824 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830464.223166:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e25820fe200/0x575506951eea09d0 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830464.223175:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e25820fe200/0x575506951eea09d0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830464.223190:0:5818:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e25820fe200/0x575506951eea09d0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830464.223197:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e25820fe200/0x575506951eea09d0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830464.223203:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e25820fe200/0x575506951eea09d0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830464.223209:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e25820fe200/0x575506951eea09d0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830464.223215:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e25820fe200 already unused, calling callback (ffffffffc14cb350) 00010000:00010000:3.0:1788830464.223219:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e25820fe200/0x575506951eea09d0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830464.223228:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e25820fe200/0x575506951eea09d0 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830464.224554:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788830464.224602:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e25820fe600/0x575506951eea098a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x575506951eea0983 expref: 17 pid: 5827 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788830464.224623:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257e925880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5826:1875724595115136:0@lo:104: 00010000:00010000:1.0:1788830464.224635:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2540031c00/0x575506951eea096e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x575506951eea0967 expref: 16 pid: 5824 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788830464.224654:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257e924a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5826:1875724595115264:0@lo:104: 00010000:00010000:1.0:1788830464.224666:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2540030a00/0x575506951eea093d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x575506951eea0936 expref: 15 pid: 5824 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788830464.224675:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257e925f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5826:1875724595115392:0@lo:104: 00010000:00010000:3.0:1788830464.224760:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e25820fe200/0x575506951eea09d0 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830464.224787:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788830464.229339:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257f805c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1745cc3d-3952-4cd4-9020-9b8acb483105+14:3309:x1875724595116032:12345-0@lo:103: Request processed in 6200us (6786us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830464.229366:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:0.0:1788830464.229458:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e257d80e600/0x575506951eea0905 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x575506951eea08fe expref: 13 pid: 5826 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788830464.229478:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257e924700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5826:1875724595115520:0@lo:104: 00010000:00010000:0.0:1788830464.229492:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e25820fe800/0x575506951eea08f7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x575506951eea08f0 expref: 12 pid: 5826 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788830464.229502:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257e925c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5826:1875724595115648:0@lo:104: 00010000:00010000:0.0:1788830464.229549:0:5826:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e25820fe200/0x575506951eea09d0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830464.229560:0:5826:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e25820fe200/0x575506951eea09d0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830464.229566:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e25820fe200/0x575506951eea09d0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830464.229573:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e25820fe200/0x575506951eea09d0 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788830464.229607:0:5826:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1788830464.240919:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257f804e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1745cc3d-3952-4cd4-9020-9b8acb483105:3309:1875724595116032:0@lo:103: 00000100:00100000:3.0:1788830464.240936:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257f807800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1745cc3d-3952-4cd4-9020-9b8acb483105:3309:1875724595115904:0@lo:103: 00000100:00100000:3.0:1788830464.240976:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257f807480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1745cc3d-3952-4cd4-9020-9b8acb483105:3308:1875724595116160:0@lo:103: 00000100:00100000:3.0:1788830464.240985:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257f804700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1745cc3d-3952-4cd4-9020-9b8acb483105:3308:1875724595115776:0@lo:103: 00000100:00100000:3.0:1788830464.240993:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257f806680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1745cc3d-3952-4cd4-9020-9b8acb483105:3308:1875724595116288:0@lo:103: 00000100:00100000:2.0:1788830464.315898:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255d99b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1745cc3d-3952-4cd4-9020-9b8acb483105+11:7625:x1875724595115008:12345-0@lo:253: Request processed in 116938us (117563us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830464.315914:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788830464.316059:0:7625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2566011880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1745cc3d-3952-4cd4-9020-9b8acb483105:7625:1875724595115008:0@lo:253: 10000000:01000000:3.0:1788830464.316074:0:7625:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788830464.316078:0:7625:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788830464.316079:0:7625:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788830464.316081:0:7625:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788830464.316082:0:7625:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:3.0:1788830464.316083:0:7625:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788830464.316085:0:7625:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788830464.316086:0:7625:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788830464.316088:0:7625:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1788830464.316089:0:7625:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788830464.316091:0:7625:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788830464.316115:0:7625:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9e2444ab0800 from lustre-OST0001 10000000:01000000:3.0:1788830464.316142:0:7625:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1788830464.316145:0:7625:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788830464.316153:0:7625:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9e254482b370 local copy 10000000:01000000:3.0:1788830464.316157:0:7625:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788830464.316191:0:7625:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.121@tcp lock: ffff9e257d944000/0x575506951eea09d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830464.316202:0:7625:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.121@tcp lock: ffff9e257d944000/0x575506951eea09d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830464.316242:0:7625:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.121@tcp lock: ffff9e257d944000/0x575506951eea09d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788830464.316262:0:7625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257f806680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1745cc3d-3952-4cd4-9020-9b8acb483105:7625:1875724595116416:0@lo:101: 00000100:00100000:3.0:1788830464.316297:0:7625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830464.316363:0:7625:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2553723840 going to sleep for 11 seconds 00000100:00100000:1.0:1788830464.316406:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595116416 00000100:00100000:1.0:1788830464.316413:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595116416 00000100:00100000:1.0:1788830464.316456:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788830464.316466:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255d99a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+11:7625:x1875724595116416:12345-0@lo:101: 00010000:00010000:1.0:1788830464.316480:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788830464.316494:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e25820fe600/0x575506951eea09de lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x575506951eea09d7 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830464.316516:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e25820fe600/0x575506951eea09de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x575506951eea09d7 expref: 12 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830464.316527:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e25820fe600/0x575506951eea09de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x575506951eea09d7 expref: 12 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830464.316536:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e25820fe600, rc 0) 00000100:00100000:1.0:1788830464.316582:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255d99a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+12:7625:x1875724595116416:12345-0@lo:101: Request processed in 119us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830464.316588:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788830464.316603:0:7625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257f806680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1745cc3d-3952-4cd4-9020-9b8acb483105:7625:1875724595116416:0@lo:101: 00010000:00010000:3.0:1788830464.316615:0:7625:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.121@tcp lock: ffff9e257d944000/0x575506951eea09d7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x575506951eea09de expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830464.316624:0:7625:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.121@tcp lock: ffff9e257d944000/0x575506951eea09d7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x575506951eea09de expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788830464.316742:0:7625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257f806680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1745cc3d-3952-4cd4-9020-9b8acb483105:7625:1875724595116544:0@lo:501: 00000100:00100000:3.0:1788830464.316768:0:7625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830464.316794:0:7625:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2553723840 going to sleep for 11 seconds 00000100:00100000:2.0:1788830464.316845:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595116544 00000100:00100000:2.0:1788830464.316849:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595116544 00000100:00100000:2.0:1788830464.316882:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788830464.316889:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255d99bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1745cc3d-3952-4cd4-9020-9b8acb483105+12:7625:x1875724595116544:12345-0@lo:501: 00000100:00100000:2.0:1788830464.317110:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255d99bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1745cc3d-3952-4cd4-9020-9b8acb483105+12:7625:x1875724595116544:12345-0@lo:501: Request processed in 220us (340us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788830464.317118:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788830464.317251:0:7625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257f806680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1745cc3d-3952-4cd4-9020-9b8acb483105:7625:1875724595116544:0@lo:501: 10000000:01000000:3.0:1788830464.317264:0:7625:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.121@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788830464.317291:0:7625:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.121@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788830464.317297:0:7625:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: ffff9e257d944000/0x575506951eea09d7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x575506951eea09de expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830464.317306:0:7625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: ffff9e257d944000/0x575506951eea09d7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x575506951eea09de expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830464.317313:0:7625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.121@tcp lock: ffff9e257d944000/0x575506951eea09d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x575506951eea09de expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830464.317347:0:7625:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788830464.317377:0:7625:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9e2444ab0800 10000000:01000000:3.0:1788830464.317383:0:7625:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788830464.317388:0:7625:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 00010000:00010000:0.0:1788830464.317490:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788830464.317497:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.121@tcp lock: ffff9e257d944000/0x575506951eea09d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x575506951eea09de expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830464.317504:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e257d944000 already unused, calling callback (ffffffffc1aebc20) 10000000:00010000:0.0:1788830464.317508:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.121@tcp lock: ffff9e257d944000/0x575506951eea09d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x575506951eea09de expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830464.317515:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.121@tcp lock: ffff9e257d944000/0x575506951eea09d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x575506951eea09de expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788830464.317522:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.121@tcp lock: ffff9e257d944000/0x575506951eea09d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x575506951eea09de expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788830464.317528:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788830464.317549:0:5820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.121@tcp lock: ffff9e257d944000/0x575506951eea09d7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x575506951eea09de expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830464.317555:0:5820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788830464.317587:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.121@tcp lock: ffff9e257d944000/0x575506951eea09d7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x575506951eea09de expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830464.317594:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.121@tcp lock: ffff9e257d944000/0x575506951eea09d7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x575506951eea09de expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830464.317609:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788830464.317611:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788830464.317612:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788830464.317741:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788830464.317754:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25479a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1745cc3d-3952-4cd4-9020-9b8acb483105:3310:1875724595116672:0@lo:103: 00000100:00100000:2.0:1788830464.317788:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:3.0:1788830464.317867:0:7625:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788830464.317872:0:7625:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1788830464.317875:0:7625:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1788830464.317893:0:7625:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.121@tcp lock: ffff9e257d945200/0x575506951eea09e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830464.317901:0:7625:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.121@tcp lock: ffff9e257d945200/0x575506951eea09e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830464.317909:0:7625:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.121@tcp lock: ffff9e257d945200/0x575506951eea09e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788830464.317923:0:7625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257f806680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1745cc3d-3952-4cd4-9020-9b8acb483105:7625:1875724595116800:0@lo:101: 00000100:00100000:3.0:1788830464.317950:0:7625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830464.317972:0:7625:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2553723180 going to sleep for 11 seconds 00000100:00100000:0.0:1788830464.318049:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595116672 00000100:00100000:0.0:1788830464.318061:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595116672 00000100:00100000:0.0:1788830464.318103:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788830464.318112:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2566011180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1745cc3d-3952-4cd4-9020-9b8acb483105+12:3310:x1875724595116672:12345-0@lo:103: 00000100:00100000:1.0:1788830464.318114:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595116800 00000100:00100000:1.0:1788830464.318118:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595116800 00010000:00010000:0.0:1788830464.318122:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788830464.318134:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e25820fe600/0x575506951eea09de lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x575506951eea09d7 expref: 13 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788830464.318141:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788830464.318147:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255d999450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+12:7625:x1875724595116800:12345-0@lo:101: 00010000:00010000:0.0:1788830464.318147:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788830464.318161:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788830464.318171:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e25820fea00/0x575506951eea09ec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x575506951eea09e5 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788830464.318178:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2566011180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1745cc3d-3952-4cd4-9020-9b8acb483105+12:3310:x1875724595116672:12345-0@lo:103: Request processed in 69us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830464.318184:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1788830464.318187:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e25820fea00/0x575506951eea09ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x575506951eea09e5 expref: 13 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830464.318196:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e25820fea00/0x575506951eea09ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x575506951eea09e5 expref: 12 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830464.318202:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e25820fea00, rc 0) 00000100:00100000:0.0:1788830464.318212:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25479a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1745cc3d-3952-4cd4-9020-9b8acb483105:3310:1875724595116672:0@lo:103: 00000100:00100000:1.0:1788830464.318229:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255d999450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+12:7625:x1875724595116800:12345-0@lo:101: Request processed in 82us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830464.318235:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788830464.318374:0:7625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257f806680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1745cc3d-3952-4cd4-9020-9b8acb483105:7625:1875724595116800:0@lo:101: 00010000:00010000:3.0:1788830464.318386:0:7625:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.121@tcp lock: ffff9e257d945200/0x575506951eea09e5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea09ec expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830464.318472:0:7625:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.121@tcp lock: ffff9e257d945200/0x575506951eea09e5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x575506951eea09ec expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788830464.318548:0:7625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257f806680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1745cc3d-3952-4cd4-9020-9b8acb483105:7625:1875724595116928:0@lo:501: 00000100:00100000:3.0:1788830464.318585:0:7625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830464.318607:0:7625:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2553723180 going to sleep for 11 seconds 00000100:00100000:2.0:1788830464.318672:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595116928 00000100:00100000:2.0:1788830464.318676:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595116928 00000100:00100000:2.0:1788830464.318733:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788830464.318741:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255d999050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1745cc3d-3952-4cd4-9020-9b8acb483105+12:7625:x1875724595116928:12345-0@lo:501: 00000100:00100000:2.0:1788830464.318960:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255d999050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1745cc3d-3952-4cd4-9020-9b8acb483105+12:7625:x1875724595116928:12345-0@lo:501: Request processed in 220us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830464.318968:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788830464.319558:0:7625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257f806680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1745cc3d-3952-4cd4-9020-9b8acb483105:7625:1875724595116928:0@lo:501: 00000100:00100000:3.0:1788830464.319598:0:7625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257f806680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1745cc3d-3952-4cd4-9020-9b8acb483105:7625:1875724595117056:0@lo:503: 00000100:00100000:3.0:1788830464.319647:0:7625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830464.319682:0:7625:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2553723180 going to sleep for 11 seconds 00000100:00100000:1.0:1788830464.320175:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595117056 00000100:00100000:1.0:1788830464.320182:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595117056 00000100:00100000:1.0:1788830464.320237:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788830464.320247:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255d99b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1745cc3d-3952-4cd4-9020-9b8acb483105+12:7625:x1875724595117056:12345-0@lo:503: 00000100:00100000:1.0:1788830464.320461:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255d99b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1745cc3d-3952-4cd4-9020-9b8acb483105+12:7625:x1875724595117056:12345-0@lo:503: Request processed in 215us (813us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830464.320468:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788830464.320565:0:7625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257f806680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1745cc3d-3952-4cd4-9020-9b8acb483105:7625:1875724595117056:0@lo:503: 00000040:00080000:3.0:1788830464.320936:0:7625:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788830464.321023:0:7625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257f806680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1745cc3d-3952-4cd4-9020-9b8acb483105:7625:1875724595117184:0@lo:502: 00000100:00100000:3.0:1788830464.321147:0:7625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830464.321186:0:7625:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2553723180 going to sleep for 11 seconds 00000100:00100000:2.0:1788830464.321377:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595117184 00000100:00100000:2.0:1788830464.321381:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595117184 00000100:00100000:2.0:1788830464.321431:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788830464.321439:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255d998850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1745cc3d-3952-4cd4-9020-9b8acb483105+12:7625:x1875724595117184:12345-0@lo:502: 00000100:00100000:2.0:1788830464.321600:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255d998850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1745cc3d-3952-4cd4-9020-9b8acb483105+12:7625:x1875724595117184:12345-0@lo:502: Request processed in 161us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830464.321607:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788830464.321843:0:7625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257f806680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1745cc3d-3952-4cd4-9020-9b8acb483105:7625:1875724595117184:0@lo:502: 00000040:00080000:3.0:1788830464.322741:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1788830464.322811:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1788830464.322845:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1788830464.322897:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1788830464.322930:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1788830464.322965:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1788830464.323002:0:7625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257f806680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1745cc3d-3952-4cd4-9020-9b8acb483105:7625:1875724595117312:0@lo:502: 00000100:00100000:3.0:1788830464.324013:0:7625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830464.324057:0:7625:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2553723180 going to sleep for 11 seconds 00000100:00100000:1.0:1788830464.324178:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595117312 00000100:00100000:1.0:1788830464.324189:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595117312 00000100:00100000:1.0:1788830464.324253:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788830464.324264:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255d998050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1745cc3d-3952-4cd4-9020-9b8acb483105+12:7625:x1875724595117312:12345-0@lo:502: 00000100:00100000:3.0:1788830464.329230:0:7625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257f806680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1745cc3d-3952-4cd4-9020-9b8acb483105:7625:1875724595117312:0@lo:502: 00000100:00100000:1.0:1788830464.329238:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255d998050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1745cc3d-3952-4cd4-9020-9b8acb483105+12:7625:x1875724595117312:12345-0@lo:502: Request processed in 4958us (6151us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830464.329252:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000040:00080000:3.0:1788830464.329448:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1788830464.329465:0:7625:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:1.0:1788830464.330137:0:7631:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788830464.330145:0:7631:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1788830464.330152:0:7631:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788830464.330154:0:7631:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1788830464.330159:0:7631:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788830464.330176:0:7631:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9e25474f4d28) 00000020:00000080:1.0:1788830464.330204:0:7631:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788830464.330210:0:7631:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788830464.330337:0:7631:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e2444ab0800 from lustre-OST0001, refs=2 00080000:01000000:1.0:1788830464.330345:0:7631:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788830464.330351:0:7631:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x575506951eea09fa 00010000:00010000:1.0:1788830464.335058:0:7631:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:1.0:1788830464.335625:0:7631:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:1.0:1788830464.338524:0:7631:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1788830464.338914:0:7631:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:1.0:1788830464.343106:0:7631:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:1.0:1788830464.347990:0:7631:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:1.0:1788830464.350549:0:7631:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1788830464.350566:0:7631:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788830464.350574:0:7631:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788830464.350577:0:7631:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1788830464.350580:0:7631:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788830464.350584:0:7631:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788830464.350586:0:7631:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788830464.350589:0:7631:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788830464.350591:0:7631:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788830464.350651:0:7631:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788830464.350655:0:7631:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788830464.350656:0:7631:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788830464.350660:0:7631:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1788830464.350961:0:7625:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:3.0:1788830464.350987:0:7625:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.121@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1788830464.351017:0:7625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: ffff9e257d945200/0x575506951eea09e5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea09ec expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830464.351030:0:7625:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.121@tcp lock: ffff9e257d945200/0x575506951eea09e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea09ec expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788830464.351039:0:7625:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e2444ab0800 from 1 10000000:01000000:3.0:1788830464.351042:0:7625:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788830464.351079:0:7625:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.121@tcp lock: ffff9e257d944800/0x575506951eea0a01 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830464.351087:0:7625:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.121@tcp lock: ffff9e257d944800/0x575506951eea0a01 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830464.351098:0:7625:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.121@tcp lock: ffff9e257d944800/0x575506951eea0a01 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788830464.351123:0:7625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257f806680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1745cc3d-3952-4cd4-9020-9b8acb483105:7625:1875724595117440:0@lo:101: 00000100:00100000:3.0:1788830464.351194:0:7625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830464.351232:0:7625:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2553723540 going to sleep for 11 seconds 00000100:00100000:0.0:1788830464.352746:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595117440 00000100:00100000:0.0:1788830464.352757:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595117440 00000100:00100000:0.0:1788830464.352804:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788830464.352814:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255d999c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+12:7625:x1875724595117440:12345-0@lo:101: 00010000:00010000:0.0:1788830464.352829:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788830464.352845:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2540030a00/0x575506951eea0a08 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x575506951eea0a01 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830464.352869:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2540030a00/0x575506951eea0a08 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x575506951eea0a01 expref: 13 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830464.352879:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2540030a00/0x575506951eea0a08 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x575506951eea0a01 expref: 13 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830464.352887:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2540030a00, rc 0) 00000100:00100000:0.0:1788830464.352959:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255d999c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+13:7625:x1875724595117440:12345-0@lo:101: Request processed in 146us (1764us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830464.352979:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788830464.353227:0:7625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257f806680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1745cc3d-3952-4cd4-9020-9b8acb483105:7625:1875724595117440:0@lo:101: 00010000:00010000:3.0:1788830464.353244:0:7625:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.121@tcp lock: ffff9e257d944800/0x575506951eea0a01 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea0a08 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830464.353253:0:7625:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.121@tcp lock: ffff9e257d944800/0x575506951eea0a01 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x575506951eea0a08 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788830464.353369:0:7625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257f806680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1745cc3d-3952-4cd4-9020-9b8acb483105:7625:1875724595117568:0@lo:501: 00000100:00100000:3.0:1788830464.353488:0:7625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830464.353525:0:7625:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2553723540 going to sleep for 11 seconds 00000100:00100000:3.0:1788830464.353544:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595117568 00000100:00100000:3.0:1788830464.353549:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595117568 00000100:00100000:3.0:1788830464.353577:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788830464.353584:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255d99a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1745cc3d-3952-4cd4-9020-9b8acb483105+13:7625:x1875724595117568:12345-0@lo:501: 00000100:00100000:3.0:1788830464.353819:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255d99a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1745cc3d-3952-4cd4-9020-9b8acb483105+13:7625:x1875724595117568:12345-0@lo:501: Request processed in 235us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830464.353826:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788830464.353851:0:7625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257f806680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1745cc3d-3952-4cd4-9020-9b8acb483105:7625:1875724595117568:0@lo:501: 00000100:00100000:3.0:1788830464.353875:0:7625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257f806680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1745cc3d-3952-4cd4-9020-9b8acb483105:7625:1875724595117696:0@lo:503: 00000100:00100000:3.0:1788830464.355616:0:7625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830464.356876:0:7625:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2553723540 going to sleep for 11 seconds 00000100:00100000:2.0:1788830464.359506:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595117696 00000100:00100000:2.0:1788830464.359521:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595117696 00000100:00100000:1.0:1788830464.360385:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788830464.360409:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255d998450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1745cc3d-3952-4cd4-9020-9b8acb483105+13:7625:x1875724595117696:12345-0@lo:503: 00000100:00100000:1.0:1788830464.360856:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255d998450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1745cc3d-3952-4cd4-9020-9b8acb483105+13:7625:x1875724595117696:12345-0@lo:503: Request processed in 451us (5245us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830464.360865:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788830464.362044:0:7625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257f806680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1745cc3d-3952-4cd4-9020-9b8acb483105:7625:1875724595117696:0@lo:503: 00000040:00080000:3.0:1788830464.362385:0:7625:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788830464.362484:0:7625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257f806680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1745cc3d-3952-4cd4-9020-9b8acb483105:7625:1875724595117824:0@lo:502: 00000100:00100000:3.0:1788830464.362552:0:7625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830464.362600:0:7625:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2553723540 going to sleep for 11 seconds 00000100:00100000:1.0:1788830464.362828:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595117824 00000100:00100000:1.0:1788830464.362836:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595117824 00000100:00100000:1.0:1788830464.362879:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788830464.362887:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255d99b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+13:7625:x1875724595117824:12345-0@lo:502: 00000100:00100000:1.0:1788830464.363182:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255d99b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+13:7625:x1875724595117824:12345-0@lo:502: Request processed in 294us (628us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830464.363189:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788830464.363374:0:7625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257f806680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1745cc3d-3952-4cd4-9020-9b8acb483105:7625:1875724595117824:0@lo:502: 00000040:00080000:3.0:1788830464.363642:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1788830464.363692:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1788830464.363755:0:7625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257f806680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1745cc3d-3952-4cd4-9020-9b8acb483105:7625:1875724595117952:0@lo:502: 00000100:00100000:3.0:1788830464.363795:0:7625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830464.363822:0:7625:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2553723540 going to sleep for 11 seconds 00000100:00100000:1.0:1788830464.364684:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595117952 00000100:00100000:1.0:1788830464.364693:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595117952 00000100:00100000:1.0:1788830464.364761:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788830464.364769:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255d99ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+13:7625:x1875724595117952:12345-0@lo:502: 00000100:00100000:1.0:1788830464.364952:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255d99ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+13:7625:x1875724595117952:12345-0@lo:502: Request processed in 183us (1156us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830464.364959:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788830464.365742:0:7625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257f806680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1745cc3d-3952-4cd4-9020-9b8acb483105:7625:1875724595117952:0@lo:502: 00000040:00080000:3.0:1788830464.365886:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1788830464.366009:0:7625:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1788830464.366702:0:7635:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788830464.366782:0:7635:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788830464.366785:0:7635:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788830464.366792:0:7635:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e2444ab0800 00000020:00000080:0.0:1788830464.366794:0:7635:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788830464.366816:0:7635:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788830464.366820:0:7635:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788830464.366821:0:7635:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1788830464.366824:0:7635:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1788830464.367096:0:7625:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1788830464.367118:0:7625:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788830464.367166:0:7625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: ffff9e257d944800/0x575506951eea0a01 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea0a08 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830464.367179:0:7625:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.121@tcp lock: ffff9e257d944800/0x575506951eea0a01 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea0a08 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788830464.367214:0:7625:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788830464.367218:0:7625:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9e2444ab0800 10000000:01000000:3.0:1788830464.367222:0:7625:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9e2444ab0800 10000000:01000000:3.0:1788830464.367226:0:7625:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788830464.367245:0:7625:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9e2444ab0800 from 1 10000000:01000000:3.0:1788830464.367247:0:7625:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788830464.367280:0:7625:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.121@tcp lock: ffff9e257d945400/0x575506951eea0a0f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830464.367288:0:7625:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.121@tcp lock: ffff9e257d945400/0x575506951eea0a0f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830464.367298:0:7625:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.121@tcp lock: ffff9e257d945400/0x575506951eea0a0f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788830464.367318:0:7625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257f806680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1745cc3d-3952-4cd4-9020-9b8acb483105:7625:1875724595118080:0@lo:101: 00000100:00100000:3.0:1788830464.367382:0:7625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830464.367428:0:7625:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2553723540 going to sleep for 11 seconds 00000100:00100000:0.0:1788830464.367593:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595118080 00000100:00100000:0.0:1788830464.367599:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595118080 00000100:00100000:0.0:1788830464.367644:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788830464.367653:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255d998c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1745cc3d-3952-4cd4-9020-9b8acb483105+13:7625:x1875724595118080:12345-0@lo:101: 00010000:00010000:0.0:1788830464.367665:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788830464.367678:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2540031c00/0x575506951eea0a16 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x575506951eea0a0f expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830464.367698:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2540031c00/0x575506951eea0a16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x575506951eea0a0f expref: 14 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830464.367733:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2540031c00/0x575506951eea0a16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x575506951eea0a0f expref: 14 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830464.367742:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2540031c00, rc 0) 00000100:00100000:0.0:1788830464.367780:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255d998c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1745cc3d-3952-4cd4-9020-9b8acb483105+14:7625:x1875724595118080:12345-0@lo:101: Request processed in 128us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830464.367785:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788830464.367881:0:7625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257f806680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1745cc3d-3952-4cd4-9020-9b8acb483105:7625:1875724595118080:0@lo:101: 00010000:00010000:3.0:1788830464.367904:0:7625:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.121@tcp lock: ffff9e257d945400/0x575506951eea0a0f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea0a16 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830464.367926:0:7625:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.121@tcp lock: ffff9e257d945400/0x575506951eea0a0f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x575506951eea0a16 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788830464.367999:0:7625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257f806680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1745cc3d-3952-4cd4-9020-9b8acb483105:7625:1875724595118208:0@lo:501: 00000100:00100000:3.0:1788830464.368025:0:7625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830464.368038:0:7625:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2553723540 going to sleep for 11 seconds 00000100:00100000:2.0:1788830464.368178:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595118208 00000100:00100000:2.0:1788830464.368183:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595118208 00000100:00100000:2.0:1788830464.368216:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788830464.368224:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255d99a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+14:7625:x1875724595118208:12345-0@lo:501: 00000100:00100000:2.0:1788830464.368580:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255d99a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+14:7625:x1875724595118208:12345-0@lo:501: Request processed in 357us (554us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830464.368594:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788830464.368805:0:7625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257f806680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1745cc3d-3952-4cd4-9020-9b8acb483105:7625:1875724595118208:0@lo:501: 00000100:00100000:3.0:1788830464.368835:0:7625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257f806680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1745cc3d-3952-4cd4-9020-9b8acb483105:7625:1875724595118336:0@lo:503: 00000100:00100000:3.0:1788830464.368874:0:7625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830464.369036:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595118336 00000100:00100000:0.0:1788830464.369047:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595118336 00000100:00100000:0.0:1788830464.369072:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788830464.369079:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255d999850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1745cc3d-3952-4cd4-9020-9b8acb483105+14:7625:x1875724595118336:12345-0@lo:503: 00000100:00100000:0.0:1788830464.369210:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255d999850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1745cc3d-3952-4cd4-9020-9b8acb483105+14:7625:x1875724595118336:12345-0@lo:503: Request processed in 131us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830464.369217:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788830464.369340:0:7625:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2553723540 going to sleep for 11 seconds 00000100:00100000:3.0:1788830464.369364:0:7625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257f806680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1745cc3d-3952-4cd4-9020-9b8acb483105:7625:1875724595118336:0@lo:503: 00000040:00080000:3.0:1788830464.369682:0:7625:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788830464.369764:0:7625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257f806680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1745cc3d-3952-4cd4-9020-9b8acb483105:7625:1875724595118464:0@lo:502: 00000100:00100000:3.0:1788830464.369800:0:7625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830464.369821:0:7625:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2553723540 going to sleep for 11 seconds 00000100:00100000:2.0:1788830464.369879:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595118464 00000100:00100000:2.0:1788830464.369883:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595118464 00000100:00100000:2.0:1788830464.369962:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788830464.369969:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2574712850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+14:7625:x1875724595118464:12345-0@lo:502: 00000100:00100000:2.0:1788830464.370476:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2574712850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+14:7625:x1875724595118464:12345-0@lo:502: Request processed in 506us (673us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830464.370483:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788830464.370654:0:7625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257f806680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1745cc3d-3952-4cd4-9020-9b8acb483105:7625:1875724595118464:0@lo:502: 00000040:00080000:3.0:1788830464.371218:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1788830464.371347:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1788830464.371471:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1788830464.371524:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1788830464.371560:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1788830464.371622:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1788830464.371659:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1788830464.371691:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1788830464.372046:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1788830464.372099:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1788830464.372144:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1788830464.372203:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1788830464.372317:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1788830464.372369:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1788830464.372506:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1788830464.372547:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1788830464.372583:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1788830464.372648:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1788830464.372685:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1788830464.373376:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1788830464.373535:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1788830464.373575:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1788830464.373607:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1788830464.373655:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1788830464.373689:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:3.0:1788830464.373889:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:3.0:1788830464.373936:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:3.0:1788830464.373969:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:3.0:1788830464.374006:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:3.0:1788830464.374053:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:3.0:1788830464.374090:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:3.0:1788830464.374125:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:3.0:1788830464.374159:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:3.0:1788830464.374208:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:3.0:1788830464.374324:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:3.0:1788830464.374472:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:3.0:1788830464.374514:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:3.0:1788830464.374563:0:7625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257f806680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1745cc3d-3952-4cd4-9020-9b8acb483105:7625:1875724595118592:0@lo:502: 00000100:00100000:3.0:1788830464.374639:0:7625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830464.374766:0:7625:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2553723540 going to sleep for 11 seconds 00000100:00100000:2.0:1788830464.375127:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595118592 00000100:00100000:2.0:1788830464.375135:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595118592 00000100:00100000:2.0:1788830464.375219:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788830464.375240:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2574713c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+14:7625:x1875724595118592:12345-0@lo:502: 00000100:00100000:2.0:1788830464.375544:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2574713c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+14:7625:x1875724595118592:12345-0@lo:502: Request processed in 316us (904us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830464.375552:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788830464.375770:0:7625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257f806680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1745cc3d-3952-4cd4-9020-9b8acb483105:7625:1875724595118592:0@lo:502: 00000040:00080000:3.0:1788830464.375857:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:3.0:1788830464.375869:0:7625:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:3.0:1788830464.376621:0:7636:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1788830464.376636:0:7636:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9e256601cd28) 00000020:00000080:3.0:1788830464.376656:0:7636:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:3.0:1788830464.376879:0:7636:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e2444ab0800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788830464.376884:0:7636:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e2444ab0800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788830464.376887:0:7636:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e2444ab0800 3 00010000:00080000:3.0:1788830464.376915:0:7636:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e2445b74000@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.121@tcp at head 00010000:00010000:3.0:1788830464.379378:0:7636:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:3.0:1788830464.379774:0:7636:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1788830464.379814:0:7636:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788830464.379828:0:7636:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x575506951eea0a24 00000100:00080000:3.0:1788830464.379839:0:7636:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788830464.379845:0:7636:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9e2445b74000 using connection 192.168.201.121@tcp/0@lo 00000100:00100000:3.0:1788830464.379882:0:7636:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e257f806680 x1875724595118720/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788830464.379910:0:7636:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788830464.380139:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257f806680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3306:1875724595118720:0@lo:38: 00000100:00100000:0.0:1788830464.380211:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830464.380282:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595118720 00000100:00100000:0.0:1788830464.380289:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595118720 00000100:00100000:0.0:1788830464.380321:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788830464.380329:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25479a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3306:x1875724595118720:12345-0@lo:38: 00010000:00080000:0.0:1788830464.380351:0:5834:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 217 last 0 00000020:00000080:0.0:1788830464.380421:0:5834:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x575506951eea0a2b 00000004:00100000:0.0:1788830464.380436:0:5834:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788830464.380463:0:5834:0:(import.c:65:import_set_state_nolock()) ffff9e2444add800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788830464.380510:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25479a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875724595118720:12345-0@lo:38: Request processed in 180us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830464.380517:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788830464.380556:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e257f806680 x1875724595118720/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788830474 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788830464.380567:0:3306:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788830464.380574:0:3306:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:0.0:1788830464.380581:0:3306:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788830464.380585:0:3306:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788830464.380587:0:3306:0:(import.c:65:import_set_state_nolock()) ffff9e2445b74000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788830464.380593:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257f806680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3306:1875724595118720:0@lo:38: 00000040:00080000:1.0:1788830464.382083:0:7636:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:0.0:1788830464.382223:0:7625:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:0.0:1788830464.382258:0:7625:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.121@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788830464.382278:0:7625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: ffff9e257d945400/0x575506951eea0a0f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea0a16 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830464.382291:0:7625:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.121@tcp lock: ffff9e257d945400/0x575506951eea0a0f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea0a16 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788830464.382339:0:7625:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788830464.382342:0:7625:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788830464.382343:0:7625:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788830464.382344:0:7625:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788830464.382346:0:7625:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788830464.382347:0:7625:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788830464.382349:0:7625:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788830464.382350:0:7625:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788830464.382364:0:7625:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788830464.382365:0:7625:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788830464.382366:0:7625:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788830464.382371:0:7625:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:0.0:1788830464.382373:0:7625:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788830464.382375:0:7625:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788830464.382376:0:7625:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788830464.382377:0:7625:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788830464.382378:0:7625:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788830464.382379:0:7625:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788830464.382380:0:7625:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788830464.382381:0:7625:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788830464.382382:0:7625:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788830464.382383:0:7625:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788830464.382384:0:7625:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788830464.382425:0:7625:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1788830464.382441:0:7625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25479a3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1745cc3d-3952-4cd4-9020-9b8acb483105:7625:1875724595118848:0@lo:253: 00000100:00100000:0.0:1788830464.382502:0:7625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830464.382536:0:7625:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2548317a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788830464.382556:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595118848 00000100:00100000:0.0:1788830464.382567:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595118848 00000100:00100000:0.0:1788830464.382614:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788830464.382622:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2574711450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1745cc3d-3952-4cd4-9020-9b8acb483105+14:7625:x1875724595118848:12345-0@lo:253: 20000000:01000000:0.0:1788830464.382663:0:5827:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1788830464.382677:0:5827:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1788830464.383627:0:7637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257f804700 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7637:1875724595118976:0@lo:901: 00000100:00100000:3.0:1788830464.383679:0:7637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830464.383727:0:7637:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2553723cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788830464.383788:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595118976 00000100:00100000:1.0:1788830464.383794:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595118976 00000100:00100000:1.0:1788830464.383847:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788830464.383857:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257f807480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7637:x1875724595118976:12345-0@lo:901: 00000100:00100000:1.0:1788830464.384158:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257f807480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7637:x1875724595118976:12345-0@lo:901: Request processed in 302us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830464.384166:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1788830464.384222:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788830464.384260:0:7637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e257f804700 x1875724595118976/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1788830480 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788830464.384273:0:7637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257f804700 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7637:1875724595118976:0@lo:901: 10000000:01000000:3.0:1788830464.401197:0:5829:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788830464.401205:0:5829:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9e2565dcd800 from 30 10000000:01000000:3.0:1788830464.401221:0:5829:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788830464.401322:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.121@tcp lock: ffff9e257d945c00/0x575506951eea0a32 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830464.401335:0:5829:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.121@tcp lock: ffff9e257d945c00/0x575506951eea0a32 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830464.401347:0:5829:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.121@tcp lock: ffff9e257d945c00/0x575506951eea0a32 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788830464.401383:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257f804700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1745cc3d-3952-4cd4-9020-9b8acb483105:5829:1875724595119104:0@lo:101: 00000100:00100000:3.0:1788830464.401518:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830464.401591:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2553723480 going to sleep for 11 seconds 00000100:00100000:2.0:1788830464.403782:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595119104 00000100:00100000:2.0:1788830464.403795:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595119104 00000100:00100000:2.0:1788830464.403847:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788830464.403857:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2574711050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+15:5829:x1875724595119104:12345-0@lo:101: 00010000:00010000:2.0:1788830464.403872:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788830464.403889:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e257d80e200/0x575506951eea0a39 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x575506951eea0a32 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830464.403914:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e257d80e200/0x575506951eea0a39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x575506951eea0a32 expref: 16 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830464.403926:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e257d80e200/0x575506951eea0a39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x575506951eea0a32 expref: 16 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830464.403946:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e257d80e200, rc 0) 00000100:00100000:2.0:1788830464.404019:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2574711050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+16:5829:x1875724595119104:12345-0@lo:101: Request processed in 163us (2500us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830464.404026:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788830464.404128:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257f804700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1745cc3d-3952-4cd4-9020-9b8acb483105:5829:1875724595119104:0@lo:101: 00010000:00010000:3.0:1788830464.404147:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.121@tcp lock: ffff9e257d945c00/0x575506951eea0a32 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea0a39 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830464.404158:0:5829:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.121@tcp lock: ffff9e257d945c00/0x575506951eea0a32 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x575506951eea0a39 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788830464.404225:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257f804700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1745cc3d-3952-4cd4-9020-9b8acb483105:5829:1875724595119232:0@lo:501: 00000100:00100000:3.0:1788830464.404275:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830464.404308:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2553723480 going to sleep for 11 seconds 00000100:00100000:2.0:1788830464.404478:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595119232 00000100:00100000:2.0:1788830464.404483:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595119232 00000100:00100000:2.0:1788830464.404511:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788830464.404517:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2574713850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+16:5829:x1875724595119232:12345-0@lo:501: 00000100:00100000:2.0:1788830464.404756:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2574713850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+16:5829:x1875724595119232:12345-0@lo:501: Request processed in 238us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830464.404763:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788830464.404841:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257f804700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1745cc3d-3952-4cd4-9020-9b8acb483105:5829:1875724595119232:0@lo:501: 00000100:00100000:3.0:1788830464.404869:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257f804700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1745cc3d-3952-4cd4-9020-9b8acb483105:5829:1875724595119360:0@lo:503: 00000100:00100000:3.0:1788830464.404909:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830464.404960:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2553723480 going to sleep for 11 seconds 00000100:00100000:2.0:1788830464.408511:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595119360 00000100:00100000:2.0:1788830464.408528:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595119360 00000100:00100000:2.0:1788830464.408581:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788830464.408591:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2574710850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+16:5829:x1875724595119360:12345-0@lo:503: 00000100:00100000:2.0:1788830464.408817:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2574710850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+16:5829:x1875724595119360:12345-0@lo:503: Request processed in 226us (3906us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830464.408825:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788830464.408990:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257f804700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1745cc3d-3952-4cd4-9020-9b8acb483105:5829:1875724595119360:0@lo:503: 00000100:00100000:2.0:1788830464.409643:0:7639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2566012300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1745cc3d-3952-4cd4-9020-9b8acb483105:7639:1875724595119488:0@lo:502: 00000100:00100000:2.0:1788830464.409692:0:7639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788830464.409756:0:7639:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e257f6fae40 going to sleep for 11 seconds 00000100:00100000:0.0:1788830464.410338:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595119488 00000100:00100000:0.0:1788830464.410346:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595119488 00000100:00100000:0.0:1788830464.410411:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788830464.410421:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2574711c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+16:7639:x1875724595119488:12345-0@lo:502: 00000100:00100000:0.0:1788830464.410629:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2574711c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+16:7639:x1875724595119488:12345-0@lo:502: Request processed in 210us (936us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830464.410636:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788830464.411427:0:7639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2566012300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1745cc3d-3952-4cd4-9020-9b8acb483105:7639:1875724595119488:0@lo:502: 00000100:00100000:0.0:1788830464.411493:0:7639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25479a1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1745cc3d-3952-4cd4-9020-9b8acb483105:7639:1875724595119616:0@lo:502: 00000100:00100000:0.0:1788830464.411539:0:7639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830464.411568:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595119616 00000100:00100000:0.0:1788830464.411573:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595119616 00000100:00100000:0.0:1788830464.411606:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788830464.411613:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2574712450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+16:7639:x1875724595119616:12345-0@lo:502: 00000100:00100000:0.0:1788830464.411794:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2574712450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+16:7639:x1875724595119616:12345-0@lo:502: Request processed in 181us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830464.411801:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788830464.411841:0:7639:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2548317540 going to sleep for 11 seconds 00000100:00100000:0.0:1788830464.411854:0:7639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25479a1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1745cc3d-3952-4cd4-9020-9b8acb483105:7639:1875724595119616:0@lo:502: 00000040:00080000:0.0:1788830464.411872:0:7639:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1788830464.411927:0:5829:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1788830464.411951:0:5829:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.121@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788830464.411960:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: ffff9e257d945c00/0x575506951eea0a32 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea0a39 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830464.411970:0:5829:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.121@tcp lock: ffff9e257d945c00/0x575506951eea0a32 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea0a39 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788830464.411980:0:5829:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1788830464.411983:0:5829:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:0.0:1788830464.411985:0:5829:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788830464.412007:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.121@tcp lock: ffff9e2540031200/0x575506951eea0a40 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830464.412014:0:5829:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.121@tcp lock: ffff9e2540031200/0x575506951eea0a40 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830464.412023:0:5829:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.121@tcp lock: ffff9e2540031200/0x575506951eea0a40 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788830464.412035:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25479a1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1745cc3d-3952-4cd4-9020-9b8acb483105:5829:1875724595119744:0@lo:101: 00000100:00100000:0.0:1788830464.412058:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830464.412071:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2548317540 going to sleep for 11 seconds 00000100:00100000:0.0:1788830464.412082:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595119744 00000100:00100000:0.0:1788830464.412085:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595119744 00000100:00100000:0.0:1788830464.412106:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788830464.412112:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2574710450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+16:5829:x1875724595119744:12345-0@lo:101: 00010000:00010000:0.0:1788830464.412120:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788830464.412134:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2540031e00/0x575506951eea0a47 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x575506951eea0a40 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830464.412168:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2540031e00/0x575506951eea0a47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x575506951eea0a40 expref: 17 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830464.412178:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2540031e00/0x575506951eea0a47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x575506951eea0a40 expref: 17 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830464.412187:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2540031e00, rc 0) 00000100:00100000:0.0:1788830464.412216:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2574710450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+17:5829:x1875724595119744:12345-0@lo:101: Request processed in 103us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830464.412222:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788830464.412270:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25479a1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1745cc3d-3952-4cd4-9020-9b8acb483105:5829:1875724595119744:0@lo:101: 00010000:00010000:0.0:1788830464.412281:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.121@tcp lock: ffff9e2540031200/0x575506951eea0a40 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea0a47 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830464.412291:0:5829:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.121@tcp lock: ffff9e2540031200/0x575506951eea0a40 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x575506951eea0a47 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788830464.412345:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25479a1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1745cc3d-3952-4cd4-9020-9b8acb483105:5829:1875724595119872:0@lo:501: 00000100:00100000:0.0:1788830464.412383:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830464.412396:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2548317540 going to sleep for 11 seconds 00000100:00100000:0.0:1788830464.412408:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595119872 00000100:00100000:0.0:1788830464.412411:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595119872 00000100:00100000:0.0:1788830464.412431:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788830464.412437:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2574713450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+17:5829:x1875724595119872:12345-0@lo:501: 00000100:00100000:0.0:1788830464.412661:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2574713450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+17:5829:x1875724595119872:12345-0@lo:501: Request processed in 224us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830464.412668:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788830464.412703:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25479a1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1745cc3d-3952-4cd4-9020-9b8acb483105:5829:1875724595119872:0@lo:501: 00000100:00100000:0.0:1788830464.412756:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25479a1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1745cc3d-3952-4cd4-9020-9b8acb483105:5829:1875724595120000:0@lo:503: 00000100:00100000:0.0:1788830464.412793:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830464.412811:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2548317540 going to sleep for 11 seconds 00000100:00100000:0.0:1788830464.412848:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595120000 00000100:00100000:0.0:1788830464.412852:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595120000 00000100:00100000:0.0:1788830464.412874:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788830464.412881:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2574712c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+17:5829:x1875724595120000:12345-0@lo:503: 00000100:00100000:0.0:1788830464.413024:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2574712c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+17:5829:x1875724595120000:12345-0@lo:503: Request processed in 143us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830464.413030:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788830464.413064:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25479a1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1745cc3d-3952-4cd4-9020-9b8acb483105:5829:1875724595120000:0@lo:503: 00000100:00100000:0.0:1788830464.414486:0:7640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25479a1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1745cc3d-3952-4cd4-9020-9b8acb483105:7640:1875724595120128:0@lo:502: 00000100:00100000:0.0:1788830464.414549:0:7640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830464.414591:0:7640:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2548317600 going to sleep for 11 seconds 00000100:00100000:1.0:1788830464.414811:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595120128 00000100:00100000:1.0:1788830464.414818:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595120128 00000100:00100000:1.0:1788830464.414864:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788830464.414873:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2574710c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+17:7640:x1875724595120128:12345-0@lo:502: 00000100:00100000:1.0:1788830464.415081:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2574710c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+17:7640:x1875724595120128:12345-0@lo:502: Request processed in 209us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830464.415088:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788830464.415809:0:7640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25479a1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1745cc3d-3952-4cd4-9020-9b8acb483105:7640:1875724595120128:0@lo:502: 00000020:01000000:0.0:1788830464.415840:0:7640:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788830464.415848:0:7640:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788830464.415851:0:7640:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788830464.415855:0:7640:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788830464.415857:0:7640:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788830464.415878:0:7640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25479a1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1745cc3d-3952-4cd4-9020-9b8acb483105:7640:1875724595120256:0@lo:502: 00000100:00100000:0.0:1788830464.415972:0:7640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830464.415996:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595120256 00000100:00100000:0.0:1788830464.416000:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595120256 00000100:00100000:0.0:1788830464.416029:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788830464.416036:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2574712050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+17:7640:x1875724595120256:12345-0@lo:502: 00000100:00100000:0.0:1788830464.416191:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2574712050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+17:7640:x1875724595120256:12345-0@lo:502: Request processed in 155us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830464.416197:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788830464.416244:0:7640:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2548317600 going to sleep for 11 seconds 00000100:00100000:0.0:1788830464.416257:0:7640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25479a1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1745cc3d-3952-4cd4-9020-9b8acb483105:7640:1875724595120256:0@lo:502: 00000020:01000000:0.0:1788830464.416274:0:7640:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788830464.416278:0:7640:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788830464.416280:0:7640:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788830464.416283:0:7640:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:0.0:1788830464.416332:0:5829:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:0.0:1788830464.416349:0:5829:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.121@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1788830464.416369:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: ffff9e2540031200/0x575506951eea0a40 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea0a47 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830464.416382:0:5829:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.121@tcp lock: ffff9e2540031200/0x575506951eea0a40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea0a47 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788830464.416391:0:5829:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788830464.416394:0:5829:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9e255d9b0800 from 30 10000000:01000000:0.0:1788830464.416397:0:5829:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788830464.416430:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.121@tcp lock: ffff9e2445b7fc00/0x575506951eea0a4e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830464.416438:0:5829:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.121@tcp lock: ffff9e2445b7fc00/0x575506951eea0a4e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830464.416448:0:5829:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.121@tcp lock: ffff9e2445b7fc00/0x575506951eea0a4e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788830464.416459:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25479a1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1745cc3d-3952-4cd4-9020-9b8acb483105:5829:1875724595120384:0@lo:101: 00000100:00100000:0.0:1788830464.416492:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830464.416518:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2548317600 going to sleep for 11 seconds 00000100:00100000:0.0:1788830464.416532:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595120384 00000100:00100000:0.0:1788830464.416535:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595120384 00000100:00100000:0.0:1788830464.416557:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788830464.416562:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2574711850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+17:5829:x1875724595120384:12345-0@lo:101: 00010000:00010000:0.0:1788830464.416570:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788830464.416580:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2445b7e200/0x575506951eea0a55 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x575506951eea0a4e expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830464.416606:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2445b7e200/0x575506951eea0a55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x575506951eea0a4e expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830464.416616:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2445b7e200/0x575506951eea0a55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x575506951eea0a4e expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830464.416625:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2445b7e200, rc 0) 00000100:00100000:0.0:1788830464.416656:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2574711850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+18:5829:x1875724595120384:12345-0@lo:101: Request processed in 92us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830464.416663:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788830464.416697:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25479a1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1745cc3d-3952-4cd4-9020-9b8acb483105:5829:1875724595120384:0@lo:101: 00010000:00010000:0.0:1788830464.416744:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.121@tcp lock: ffff9e2445b7fc00/0x575506951eea0a4e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea0a55 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830464.416754:0:5829:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.121@tcp lock: ffff9e2445b7fc00/0x575506951eea0a4e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x575506951eea0a55 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788830464.416791:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25479a1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1745cc3d-3952-4cd4-9020-9b8acb483105:5829:1875724595120512:0@lo:501: 00000100:00100000:0.0:1788830464.416825:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830464.416836:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2548317600 going to sleep for 11 seconds 00000100:00100000:0.0:1788830464.416849:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595120512 00000100:00100000:0.0:1788830464.416852:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595120512 00000100:00100000:0.0:1788830464.416870:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788830464.416876:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2574713050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+18:5829:x1875724595120512:12345-0@lo:501: 00000100:00100000:0.0:1788830464.418251:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2574713050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+18:5829:x1875724595120512:12345-0@lo:501: Request processed in 1372us (1423us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830464.418260:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788830464.419096:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25479a1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1745cc3d-3952-4cd4-9020-9b8acb483105:5829:1875724595120512:0@lo:501: 00000100:00100000:1.0:1788830464.419147:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257e926300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1745cc3d-3952-4cd4-9020-9b8acb483105:5829:1875724595120640:0@lo:503: 00000100:00100000:1.0:1788830464.419199:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830464.419249:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2544f87cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788830464.419321:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595120640 00000100:00100000:0.0:1788830464.419329:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595120640 00000100:00100000:0.0:1788830464.419388:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788830464.419406:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2574710050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1745cc3d-3952-4cd4-9020-9b8acb483105+18:5829:x1875724595120640:12345-0@lo:503: 00000100:00100000:0.0:1788830464.419577:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2574710050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1745cc3d-3952-4cd4-9020-9b8acb483105+18:5829:x1875724595120640:12345-0@lo:503: Request processed in 181us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830464.419584:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788830464.419628:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257e926300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1745cc3d-3952-4cd4-9020-9b8acb483105:5829:1875724595120640:0@lo:503: 00000100:00100000:0.0:1788830464.419830:0:7641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25479a0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1745cc3d-3952-4cd4-9020-9b8acb483105:7641:1875724595120768:0@lo:502: 00000100:00100000:0.0:1788830464.419868:0:7641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830464.419888:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595120768 00000100:00100000:0.0:1788830464.419891:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595120768 00000100:00100000:0.0:1788830464.419910:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788830464.419916:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255d949450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1745cc3d-3952-4cd4-9020-9b8acb483105+18:7641:x1875724595120768:12345-0@lo:502: 00000100:00100000:0.0:1788830464.420068:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255d949450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1745cc3d-3952-4cd4-9020-9b8acb483105+18:7641:x1875724595120768:12345-0@lo:502: Request processed in 151us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830464.420075:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788830464.420109:0:7641:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2548317d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788830464.420121:0:7641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25479a0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1745cc3d-3952-4cd4-9020-9b8acb483105:7641:1875724595120768:0@lo:502: 00000100:00100000:0.0:1788830464.420159:0:7641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25479a0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1745cc3d-3952-4cd4-9020-9b8acb483105:7641:1875724595120896:0@lo:502: 00000100:00100000:0.0:1788830464.420190:0:7641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830464.420208:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595120896 00000100:00100000:0.0:1788830464.420212:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595120896 00000100:00100000:0.0:1788830464.420230:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788830464.420236:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255d949050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1745cc3d-3952-4cd4-9020-9b8acb483105+18:7641:x1875724595120896:12345-0@lo:502: 00000100:00100000:0.0:1788830464.420350:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255d949050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1745cc3d-3952-4cd4-9020-9b8acb483105+18:7641:x1875724595120896:12345-0@lo:502: Request processed in 113us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830464.420370:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788830464.420396:0:7641:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2548317d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788830464.420408:0:7641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25479a0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1745cc3d-3952-4cd4-9020-9b8acb483105:7641:1875724595120896:0@lo:502: 00000040:00080000:0.0:1788830464.420426:0:7641:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1788830464.420470:0:5829:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1788830464.420488:0:5829:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.121@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788830464.420499:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: ffff9e2445b7fc00/0x575506951eea0a4e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea0a55 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830464.420510:0:5829:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.121@tcp lock: ffff9e2445b7fc00/0x575506951eea0a4e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea0a55 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788830464.420520:0:5829:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1788830464.420523:0:5829:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:0.0:1788830464.420526:0:5829:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788830464.420549:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.121@tcp lock: ffff9e2445b7fe00/0x575506951eea0a5c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830464.420567:0:5829:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.121@tcp lock: ffff9e2445b7fe00/0x575506951eea0a5c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830464.420576:0:5829:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.121@tcp lock: ffff9e2445b7fe00/0x575506951eea0a5c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788830464.420591:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25479a0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1745cc3d-3952-4cd4-9020-9b8acb483105:5829:1875724595121024:0@lo:101: 00000100:00100000:0.0:1788830464.420616:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830464.420629:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2548317d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788830464.420641:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595121024 00000100:00100000:0.0:1788830464.420645:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595121024 00000100:00100000:0.0:1788830464.420662:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788830464.420669:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255d94b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1745cc3d-3952-4cd4-9020-9b8acb483105+18:5829:x1875724595121024:12345-0@lo:101: 00010000:00010000:0.0:1788830464.420677:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788830464.420689:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2445b7e400/0x575506951eea0a63 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x575506951eea0a5c expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830464.420736:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2445b7e400/0x575506951eea0a63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x575506951eea0a5c expref: 19 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830464.420747:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2445b7e400/0x575506951eea0a63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x575506951eea0a5c expref: 19 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830464.420755:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2445b7e400, rc 0) 00000100:00100000:0.0:1788830464.420782:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255d94b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1745cc3d-3952-4cd4-9020-9b8acb483105+19:5829:x1875724595121024:12345-0@lo:101: Request processed in 115us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830464.420788:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788830464.420814:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25479a0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1745cc3d-3952-4cd4-9020-9b8acb483105:5829:1875724595121024:0@lo:101: 00010000:00010000:0.0:1788830464.420831:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.121@tcp lock: ffff9e2445b7fe00/0x575506951eea0a5c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea0a63 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830464.420839:0:5829:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.121@tcp lock: ffff9e2445b7fe00/0x575506951eea0a5c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x575506951eea0a63 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788830464.420874:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25479a0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1745cc3d-3952-4cd4-9020-9b8acb483105:5829:1875724595121152:0@lo:501: 00000100:00100000:0.0:1788830464.420895:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830464.420906:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2548317d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788830464.420916:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595121152 00000100:00100000:0.0:1788830464.420918:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595121152 00000100:00100000:0.0:1788830464.420933:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788830464.420938:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255d948850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1745cc3d-3952-4cd4-9020-9b8acb483105+19:5829:x1875724595121152:12345-0@lo:501: 00000100:00100000:0.0:1788830464.421132:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255d948850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1745cc3d-3952-4cd4-9020-9b8acb483105+19:5829:x1875724595121152:12345-0@lo:501: Request processed in 192us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830464.421138:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788830464.421166:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25479a0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1745cc3d-3952-4cd4-9020-9b8acb483105:5829:1875724595121152:0@lo:501: 00000100:00100000:0.0:1788830464.421186:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25479a0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1745cc3d-3952-4cd4-9020-9b8acb483105:5829:1875724595121280:0@lo:503: 00000100:00100000:0.0:1788830464.421218:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830464.421231:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e257fc239c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788830464.421241:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595121280 00000100:00100000:0.0:1788830464.421245:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595121280 00000100:00100000:0.0:1788830464.421261:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788830464.421266:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255d948050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1745cc3d-3952-4cd4-9020-9b8acb483105+19:5829:x1875724595121280:12345-0@lo:503: 00000100:00100000:0.0:1788830464.421405:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255d948050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1745cc3d-3952-4cd4-9020-9b8acb483105+19:5829:x1875724595121280:12345-0@lo:503: Request processed in 137us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830464.421416:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788830464.421457:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25479a0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1745cc3d-3952-4cd4-9020-9b8acb483105:5829:1875724595121280:0@lo:503: 00000100:00100000:1.0:1788830464.421914:0:7642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257e926300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1745cc3d-3952-4cd4-9020-9b8acb483105:7642:1875724595121408:0@lo:502: 00000100:00100000:1.0:1788830464.421952:0:7642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830464.422012:0:7642:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2544f87900 going to sleep for 11 seconds 00000100:00100000:0.0:1788830464.422144:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595121408 00000100:00100000:0.0:1788830464.422150:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595121408 00000100:00100000:0.0:1788830464.422213:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788830464.422221:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255d949c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1745cc3d-3952-4cd4-9020-9b8acb483105+19:7642:x1875724595121408:12345-0@lo:502: 00000100:00100000:0.0:1788830464.422411:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255d949c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1745cc3d-3952-4cd4-9020-9b8acb483105+19:7642:x1875724595121408:12345-0@lo:502: Request processed in 191us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830464.422418:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788830464.422496:0:7642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257e926300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1745cc3d-3952-4cd4-9020-9b8acb483105:7642:1875724595121408:0@lo:502: 00000020:01000000:0.0:1788830464.422524:0:7642:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788830464.422531:0:7642:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1788830464.422538:0:7642:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788830464.422540:0:7642:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1788830464.422544:0:7642:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788830464.422548:0:7642:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.121@tcp to nid 0x20000c0a8c979 (192.168.201.121@tcp) 00000020:01000000:0.0:1788830464.422567:0:7642:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788830464.422569:0:7642:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788830464.422584:0:7642:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9e2544834d28) 00000020:00000080:0.0:1788830464.422603:0:7642:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:0.0:1788830464.422608:0:7642:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788830464.422675:0:7642:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1788830464.422681:0:7642:0:(osd_handler.c:1573:osd_obd_connect()) connect #6 00000020:00000080:0.0:1788830464.422688:0:7642:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x575506951eea0a71 00010000:00080000:0.0:1788830464.423788:0:7642:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e2550066800@lustre-OST0001-osc-MDT0000: add connection 192.168.201.121@tcp at head 00010000:00010000:0.0:1788830464.424040:0:7642:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:0.0:1788830464.424368:0:7642:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:0.0:1788830464.424381:0:7642:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1788830464.424885:0:7642:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788830464.425096:0:7642:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788830464.425160:0:7642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:0.0:1788830464.425231:0:7642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:0.0:1788830464.425646:0:7643:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788830464.425651:0:7643:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1788830464.426607:0:7642:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788830464.426620:0:7642:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788830464.426654:0:7642:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788830464.426676:0:7642:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x575506951eea0a78 00000100:00080000:1.0:1788830464.426685:0:7642:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788830464.426691:0:7642:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9e2550066800 using connection 192.168.201.121@tcp/0@lo 00000100:00100000:1.0:1788830464.426765:0:7642:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e257e925c00 x1875724595121536/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788830464.426786:0:7642:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1788830464.426837:0:7642:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788830464.426842:0:7642:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788830464.426843:0:7642:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1788830464.426846:0:7642:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788830464.426850:0:7642:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788830464.426851:0:7642:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788830464.426861:0:7642:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788830464.426864:0:7642:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1788830464.426893:0:7642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257e924700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1745cc3d-3952-4cd4-9020-9b8acb483105:7642:1875724595121664:0@lo:502: 00000100:00100000:1.0:1788830464.426974:0:7642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788830464.427017:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595121664 00000100:00100000:1.0:1788830464.427020:0:7642:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e25429ed9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788830464.427027:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595121664 00000100:00100000:2.0:1788830464.427079:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788830464.427089:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255d94a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+19:7642:x1875724595121664:12345-0@lo:502: 00000100:00100000:2.0:1788830464.427326:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255d94a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+19:7642:x1875724595121664:12345-0@lo:502: Request processed in 237us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830464.427335:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788830464.427432:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257e925c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1875724595121536:0@lo:8: 00000100:00100000:0.0:1788830464.427468:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788830464.427546:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595121536 00000100:00100000:2.0:1788830464.427551:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595121536 00000100:00100000:2.0:1788830464.427579:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788830464.427585:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25479a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3306:x1875724595121536:12345-0@lo:8: 00000100:00100000:2.0:1788830464.427650:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25479a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3306:x1875724595121536:12345-0@lo:8: Request processed in 62us (179us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788830464.427657:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788830464.427661:0:3306:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788830464.427669:0:3306:0:(import.c:65:import_set_state_nolock()) ffff9e2550066800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788830464.427675:0:3306:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788830464.427679:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257e925c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1875724595121536:0@lo:8: 00000100:00100000:1.0:1788830464.428048:0:7642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257e924700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1745cc3d-3952-4cd4-9020-9b8acb483105:7642:1875724595121664:0@lo:502: 00000020:01000000:1.0:1788830464.428081:0:7642:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788830464.428088:0:7642:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788830464.428090:0:7642:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788830464.428094:0:7642:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:0.0:1788830464.428314:0:5829:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:0.0:1788830464.428331:0:5829:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.121@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788830464.428342:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: ffff9e2445b7fe00/0x575506951eea0a5c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea0a63 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830464.428361:0:5829:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.121@tcp lock: ffff9e2445b7fe00/0x575506951eea0a5c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea0a63 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788830464.428373:0:5829:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1788830464.428375:0:5829:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9e254482b370 from 1 10000000:01000000:0.0:1788830464.428378:0:5829:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788830464.428405:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.121@tcp lock: ffff9e2445b7fa00/0x575506951eea0a7f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830464.428413:0:5829:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.121@tcp lock: ffff9e2445b7fa00/0x575506951eea0a7f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830464.428422:0:5829:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.121@tcp lock: ffff9e2445b7fa00/0x575506951eea0a7f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788830464.428449:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25479a3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1745cc3d-3952-4cd4-9020-9b8acb483105:5829:1875724595121792:0@lo:101: 00000100:00100000:0.0:1788830464.428479:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830464.428512:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2544f87000 going to sleep for 11 seconds 20000000:01000000:0.0:1788830464.428530:0:5827:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788830464.428544:0:5827:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1788830464.428792:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595121792 00000100:00100000:2.0:1788830464.428799:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595121792 00000100:00100000:2.0:1788830464.428839:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788830464.428847:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255d948450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+19:5829:x1875724595121792:12345-0@lo:101: 00010000:00010000:2.0:1788830464.428858:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788830464.428871:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e257d80e600/0x575506951eea0a86 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x575506951eea0a7f expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830464.428892:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e257d80e600/0x575506951eea0a86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x575506951eea0a7f expref: 20 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830464.428904:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e257d80e600/0x575506951eea0a86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x575506951eea0a7f expref: 20 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830464.428913:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e257d80e600, rc 0) 00000100:00100000:2.0:1788830464.428945:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255d948450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+20:5829:x1875724595121792:12345-0@lo:101: Request processed in 98us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830464.428950:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 20000000:01000000:1.0:1788830464.429046:0:5848:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788830464.429051:0:5848:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788830464.429062:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e25820fe000/0x575506951eea0a8d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830464.429073:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e25820ff800/0x575506951eea09bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x575506951eea09b4 expref: 19 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830464.429081:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e25820fe000/0x575506951eea0a8d lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830464.429103:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e25820ff800/0x575506951eea09bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x575506951eea09b4 expref: 19 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830464.429116:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e25820ff800/0x575506951eea09bb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x575506951eea09b4 expref: 19 pid: 5826 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788830464.429125:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257e924700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5848:1875724595121920:0@lo:104: 00000100:00100000:1.0:1788830464.429152:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830464.429179:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e24469d4180 going to sleep for 11 seconds 00000100:00100000:2.0:1788830464.429377:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595121920 00000100:00100000:2.0:1788830464.429381:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595121920 00000100:00100000:2.0:1788830464.429417:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788830464.429425:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257e925f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1745cc3d-3952-4cd4-9020-9b8acb483105+3:5848:x1875724595121920:12345-0@lo:104: 00010000:00010000:2.0:1788830464.429435:0:5815:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.121@tcp lock: ffff9e2540030600/0x575506951eea09b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x575506951eea09bb expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830464.429470:0:5815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788830464.429474:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257e925f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1745cc3d-3952-4cd4-9020-9b8acb483105+3:5848:x1875724595121920:12345-0@lo:104: Request processed in 51us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830464.429480:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788830464.429531:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25479a3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1745cc3d-3952-4cd4-9020-9b8acb483105:5829:1875724595121792:0@lo:101: 00010000:00010000:0.0:1788830464.429544:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.121@tcp lock: ffff9e2445b7fa00/0x575506951eea0a7f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea0a86 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830464.429552:0:5829:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.121@tcp lock: ffff9e2445b7fa00/0x575506951eea0a7f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x575506951eea0a86 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788830464.429596:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25479a3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1745cc3d-3952-4cd4-9020-9b8acb483105:5829:1875724595122048:0@lo:501: 00000100:00100000:0.0:1788830464.429620:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830464.429640:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2544f87000 going to sleep for 11 seconds 00000100:00100000:2.0:1788830464.429676:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595122048 00000100:00100000:2.0:1788830464.429680:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595122048 00000100:00100000:2.0:1788830464.429731:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788830464.429738:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255d94ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+20:5829:x1875724595122048:12345-0@lo:501: 00000100:00100000:2.0:1788830464.429940:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255d94ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+20:5829:x1875724595122048:12345-0@lo:501: Request processed in 202us (318us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788830464.429947:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788830464.430018:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25479a3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1745cc3d-3952-4cd4-9020-9b8acb483105:5829:1875724595122048:0@lo:501: 10000000:01000000:0.0:1788830464.430037:0:5829:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.121@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788830464.430045:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: ffff9e2445b7fa00/0x575506951eea0a7f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea0a86 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830464.430051:0:5829:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.121@tcp lock: ffff9e2445b7fa00/0x575506951eea0a7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea0a86 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830464.430116:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788830464.430130:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.121@tcp lock: ffff9e2540030600/0x575506951eea09b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x575506951eea09bb expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830464.430137:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2540030600 already unused, calling callback (ffffffffc1aebc20) 10000000:00010000:1.0:1788830464.430141:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.121@tcp lock: ffff9e2540030600/0x575506951eea09b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x575506951eea09bb expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830464.430149:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.121@tcp lock: ffff9e2540030600/0x575506951eea09b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x575506951eea09bb expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788830464.430155:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.121@tcp lock: ffff9e2540030600/0x575506951eea09b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x575506951eea09bb expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788830464.430160:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788830464.430193:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.121@tcp lock: ffff9e2540030600/0x575506951eea09b4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x575506951eea09bb expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830464.430199:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788830464.430234:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.121@tcp lock: ffff9e2540030600/0x575506951eea09b4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x575506951eea09bb expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830464.430242:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.121@tcp lock: ffff9e2540030600/0x575506951eea09b4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x575506951eea09bb expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830464.430259:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788830464.430260:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788830464.430262:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788830464.430269:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788830464.430279:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257e924a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1745cc3d-3952-4cd4-9020-9b8acb483105:3309:1875724595122176:0@lo:103: 00000100:00100000:1.0:1788830464.430308:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830464.430343:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257e924700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5848:1875724595121920:0@lo:104: 00010000:00010000:1.0:1788830464.430378:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e25820fe000/0x575506951eea0a8d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788830464.430425:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595122176 00000100:00100000:0.0:1788830464.430429:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595122176 00010000:00010000:0.0:1788830464.430447:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e25820ff800/0x575506951eea09bb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x575506951eea09b4 expref: 20 pid: 5826 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788830464.430486:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788830464.430494:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2547434850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1745cc3d-3952-4cd4-9020-9b8acb483105+20:3309:x1875724595122176:12345-0@lo:103: 00010000:00010000:0.0:1788830464.430505:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788830464.430510:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e25820ff800/0x575506951eea09bb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x575506951eea09b4 expref: 20 pid: 5826 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830464.430519:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e25820ff800/0x575506951eea09bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x575506951eea09b4 expref: 20 pid: 5826 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830464.430533:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e25820ff800/0x575506951eea09bb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x575506951eea09b4 expref: 20 pid: 5826 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830464.430544:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e25820fe000/0x575506951eea0a8d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830464.430550:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e25820fe000/0x575506951eea0a8d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788830464.430561:0:5818:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001747348s 00010000:00010000:0.0:1788830464.430564:0:5818:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e25820fe000/0x575506951eea0a8d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830464.430569:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e25820fe000/0x575506951eea0a8d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830464.430575:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e25820fe000/0x575506951eea0a8d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830464.430581:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e25820fe000/0x575506951eea0a8d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830464.430592:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e25820fe000 already unused, calling callback (ffffffffc14cb350) 00010000:00010000:0.0:1788830464.430596:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e25820fe000/0x575506951eea0a8d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830464.430602:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e25820fe000/0x575506951eea0a8d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830464.430615:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e25820fe000/0x575506951eea0a8d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830464.430623:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788830464.430650:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2547434850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1745cc3d-3952-4cd4-9020-9b8acb483105+19:3309:x1875724595122176:12345-0@lo:103: Request processed in 157us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830464.430656:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:0.0:1788830464.430693:0:5848:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e25820fe000/0x575506951eea0a8d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830464.430701:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e25820fe000/0x575506951eea0a8d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830464.430732:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e25820fe000/0x575506951eea0a8d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788830464.430756:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257e924a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1745cc3d-3952-4cd4-9020-9b8acb483105:3309:1875724595122176:0@lo:103: 00000100:00100000:0.0:1788830464.459213:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2574711450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1745cc3d-3952-4cd4-9020-9b8acb483105+18:7625:x1875724595118848:12345-0@lo:253: Request processed in 76581us (76699us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830464.459237:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788830464.459442:0:7625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25479a3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1745cc3d-3952-4cd4-9020-9b8acb483105:7625:1875724595118848:0@lo:253: 10000000:01000000:2.0:1788830464.459458:0:7625:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788830464.459461:0:7625:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788830464.459463:0:7625:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788830464.459464:0:7625:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788830464.459466:0:7625:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788830464.459467:0:7625:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788830464.459468:0:7625:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788830464.459470:0:7625:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788830464.459471:0:7625:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788830464.459473:0:7625:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788830464.459474:0:7625:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788830464.459476:0:7625:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788830464.459504:0:7625:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1788830464.464413:0:7625:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1788830464.464596:0:7625:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1788830464.465056:0:7625:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1788830464.465207:0:7625:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1788830464.465482:0:7625:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1788830464.465669:0:7625:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1788830464.466657:0:7625:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1788830464.642119:0:7625:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1788830464.642126:0:7625:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1788830464.642153:0:7625:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788830464.642211:0:7625:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.121@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788830464.642224:0:7625:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1788830464.642252:0:7625:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:1.0:1788830465.062094:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788830466.076912:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788830467.099906:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788830468.130272:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788830468.827952:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25479a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875724595122304:0@lo:13: 00000100:00100000:2.0:1788830468.828034:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830468.828824:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595122304 00000100:00100000:0.0:1788830468.828835:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595122304 00000100:00100000:0.0:1788830468.829355:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788830468.829374:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2566010000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875724595122304:12345-0@lo:13: 00002000:00000024:0.0:1788830468.829408:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788830468.829466:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2566010000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875724595122304:12345-0@lo:13: Request processed in 103us (1436us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830468.829473:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788830468.829553:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e25479a3b80 x1875724595122304/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788830484 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788830468.829571:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25479a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875724595122304:0@lo:13: 00000100:00080000:1.0:1788830468.829667:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788830469.152595:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788830469.852203:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788830469.852213:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788830469.852217:0:38:0:(import.c:65:import_set_state_nolock()) ffff9e2550066800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788830469.852229:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9e2550066800 using connection 192.168.201.121@tcp/0@lo 00000100:00100000:0.0:1788830469.852254:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e25479a1880 x1875724595123072/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788830469.852352:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25479a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1875724595122816:0@lo:400: 00000100:00100000:0.0:1788830469.852420:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788830469.852523:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25479a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1745cc3d-3952-4cd4-9020-9b8acb483105:3308:1875724595122432:0@lo:400: 00000100:00100000:2.0:1788830469.852562:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788830469.852601:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25479a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1875724595122944:0@lo:400: 00000100:00100000:2.0:1788830469.852628:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788830469.852667:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595122432 00000100:00100000:2.0:1788830469.852674:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595122432 00000100:00100000:2.0:1788830469.852731:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788830469.852741:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255d948c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+18:3308:x1875724595122432:12345-0@lo:400: 00000100:00100000:2.0:1788830469.852793:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255d948c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+18:3308:x1875724595122432:12345-0@lo:400: Request processed in 53us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830469.852800:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788830469.852854:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25479a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1745cc3d-3952-4cd4-9020-9b8acb483105:3308:1875724595122432:0@lo:400: 00000100:00100000:0.0:1788830469.853092:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25479a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875724595122560:0@lo:400: 00000100:00100000:0.0:1788830469.853120:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830469.853151:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788830469.853157:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25479a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875724595122688:0@lo:400: 00000100:00100000:0.0:1788830469.853180:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830469.853224:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25479a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1875724595123072:0@lo:8: 00000100:00100000:0.0:1788830469.853246:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830469.853286:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595122816 00000100:00100000:0.0:1788830469.853290:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595122816 00000100:00100000:0.0:1788830469.853323:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595122944 00000100:00100000:0.0:1788830469.853327:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595122944 00000100:00100000:0.0:1788830469.853337:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595122560 00000100:00100000:0.0:1788830469.853339:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595122560 00000100:00100000:0.0:1788830469.853350:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788830469.853357:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25479a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875724595122816:12345-0@lo:400: 00000100:00100000:0.0:1788830469.853393:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25479a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875724595122816:12345-0@lo:400: Request processed in 36us (973us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830469.853399:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788830469.853412:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788830469.853418:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2566013b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875724595122944:12345-0@lo:400: 00000100:00100000:0.0:1788830469.853564:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2566013b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875724595122944:12345-0@lo:400: Request processed in 145us (934us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830469.853570:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788830469.853583:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788830469.853590:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25479a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875724595122560:12345-0@lo:400: 00000100:00100000:0.0:1788830469.853620:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25479a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875724595122560:12345-0@lo:400: Request processed in 32us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830469.853625:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788830469.853647:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595122688 00000100:00100000:0.0:1788830469.853651:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595122688 00000100:00100000:0.0:1788830469.853670:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595123072 00000100:00100000:0.0:1788830469.853673:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595123072 00000100:00100000:0.0:1788830469.853684:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788830469.853689:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25479a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875724595122688:12345-0@lo:400: 00000100:00100000:0.0:1788830469.853746:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25479a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875724595122688:12345-0@lo:400: Request processed in 56us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830469.853752:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788830469.853764:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788830469.853768:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25479a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3306:x1875724595123072:12345-0@lo:8: 00010000:00080000:0.0:1788830469.853793:0:6677:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 223 last 0 00000020:00000080:0.0:1788830469.853820:0:6677:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x575506951eea0a94 00002000:00100000:0.0:1788830469.853834:0:6677:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9e2446c87000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113968 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1788830469.853838:0:6677:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:0.0:1788830469.853841:0:6677:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:2.0:1788830469.854166:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788830469.854728:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e25479a1180 x1875724595122816/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788830485 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788830469.854743:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25479a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1875724595122816:0@lo:400: 00002000:00100000:0.0:1788830469.855185:0:6677:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788830469.855391:0:6677:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788830469.855423:0:6677:0:(import.c:65:import_set_state_nolock()) ffff9e2446c83800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788830469.855726:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25479a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3306:x1875724595123072:12345-0@lo:8: Request processed in 1939us (2462us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830469.855735:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1788830469.855778:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e25479a0700 x1875724595122688/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788830485 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788830469.855790:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25479a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875724595122688:0@lo:400: 00010000:00080000:0.0:1788830469.855802:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e25479a0000 x1875724595122560/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788830485 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788830469.855811:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25479a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875724595122560:0@lo:400: 00010000:00080000:0.0:1788830469.855855:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e25479a3100 x1875724595122944/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788830485 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788830469.855863:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25479a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1875724595122944:0@lo:400: 00010000:00080000:2.0:1788830469.856133:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e25479a1880 x1875724595123072/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788830479 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788830469.856146:0:3306:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1788830469.856160:0:3306:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788830469.856165:0:3306:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1788830469.856168:0:3306:0:(import.c:65:import_set_state_nolock()) ffff9e2550066800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788830469.856192:0:3306:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788830469.856198:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25479a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1875724595123072:0@lo:8: 00000004:00080000:0.0:1788830469.856271:0:7643:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788830469.856682:0:7643:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 223203971776ns, next at 0ns, rc = 0 00000001:00100000:2.0:1788830469.959001:0:7646:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000004:00080000:0.0:1788830469.969142:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:1.0:1788830470.018639:0:7644:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:1.0:1788830470.018675:0:7644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257e925880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7644:1875724595123328:0@lo:7: 00000100:00100000:1.0:1788830470.018774:0:7644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830470.018834:0:7644:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2550b87b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788830470.018853:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257e924700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875724595123200:0@lo:13: 00000100:00100000:1.0:1788830470.018877:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830470.018920:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595123328 00000100:00100000:1.0:1788830470.018927:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595123328 00000100:00100000:1.0:1788830470.018988:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788830470.018997:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257e924a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:7644:x1875724595123328:12345-0@lo:7: 00000100:00100000:1.0:1788830470.023757:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595123200 00000100:00100000:1.0:1788830470.023770:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595123200 00000100:00080000:3.0:1788830470.023786:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788830470.023834:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788830470.023846:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257e925c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1875724595123200:12345-0@lo:13: 00002000:00000024:1.0:1788830470.023876:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:1.0:1788830470.023963:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257e925c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1875724595123200:12345-0@lo:13: Request processed in 118us (5082us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830470.023970:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1788830470.024080:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e257e924700 x1875724595123200/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788830486 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788830470.024103:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257e924700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875724595123200:0@lo:13: 00002000:00080000:1.0:1788830470.025279:0:6679:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:1.0:1788830470.025358:0:6679:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:1.0:1788830470.025440:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257e924a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:7644:x1875724595123328:12345-0@lo:7: Request processed in 6441us (6664us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830470.025450:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1788830470.025530:0:7644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e257e925880 x1875724595123328/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788830486 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788830470.025546:0:7644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257e925880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7644:1875724595123328:0@lo:7: 00000004:00080000:3.0:1788830470.025560:0:7644:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:3.0:1788830470.025608:0:7644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257f804700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7644:1875724595123456:0@lo:5: 00000100:00100000:3.0:1788830470.025667:0:7644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830470.025744:0:7644:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e25656199c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788830470.026010:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595123456 00000100:00100000:1.0:1788830470.026018:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595123456 00000100:00100000:1.0:1788830470.026058:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788830470.026067:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257f807800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:7644:x1875724595123456:12345-0@lo:5: 00002000:00080000:1.0:1788830470.026091:0:6680:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1788830470.026095:0:6680:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1788830470.026615:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257f807800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7644:x1875724595123456:12345-0@lo:5: Request processed in 548us (957us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1788830470.026623:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1788830470.026767:0:7644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e257f804700 x1875724595123456/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788830486 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788830470.026783:0:7644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257f804700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7644:1875724595123456:0@lo:5: 00000004:00080000:3.0:1788830470.026794:0:7644:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:3.0:1788830470.026832:0:7644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257f804e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7644:1875724595123584:0@lo:700: 00000100:00100000:3.0:1788830470.026864:0:7644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830470.026895:0:7644:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e25656199c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788830470.026957:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595123584 00000100:00100000:1.0:1788830470.026963:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595123584 00000100:00100000:1.0:1788830470.026998:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788830470.027007:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257f807100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+6:7644:x1875724595123584:12345-0@lo:700: 00000100:00100000:1.0:1788830470.027038:0:6686:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257e926300 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6686:1875724595123712:0@lo:700: 00000100:00100000:1.0:1788830470.027070:0:6686:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830470.027090:0:6686:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2550b87240 going to sleep for 11 seconds 00000100:00100000:1.0:1788830470.027105:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595123712 00000100:00100000:1.0:1788830470.027108:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595123712 00000100:00100000:1.0:1788830470.027148:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788830470.027154:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257e925880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6686:x1875724595123712:12345-0@lo:700: 40000000:02000000:0.0:1788830470.067884:0:5839:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:1.0:1788830470.078489:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257e925880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6686:x1875724595123712:12345-0@lo:700: Request processed in 51324us (51407us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830470.078505:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788830470.078697:0:6686:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e257e926300 x1875724595123712/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788830486 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788830470.078749:0:6686:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257e926300 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6686:1875724595123712:0@lo:700: 40000000:02000000:0.0:1788830470.078763:0:6686:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00010000:00010000:3.0:1788830470.171986:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788830470.224283:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257f807100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+6:7644:x1875724595123584:12345-0@lo:700: Request processed in 197263us (197405us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830470.224326:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000001:00080000:2.0:1788830470.226074:0:7646:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00010000:00080000:3.0:1788830470.226958:0:7644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e257f804e00 x1875724595123584/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788830486 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788830470.226977:0:7644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257f804e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7644:1875724595123584:0@lo:700: 00000004:02000040:3.0:1788830470.272915:0:7644:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:3.0:1788830470.280042:0:7644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257f804e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7644:1875724595123840:0@lo:5: 00000100:00100000:3.0:1788830470.280110:0:7644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830470.280917:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595123840 00000100:00100000:0.0:1788830470.280929:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595123840 00000100:00100000:0.0:1788830470.280990:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788830470.281000:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257f805f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:7644:x1875724595123840:12345-0@lo:5: 00000100:00100000:3.0:1788830470.281834:0:7644:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e25656199c0 going to sleep for 11 seconds 00002000:00080000:0.0:1788830470.289809:0:6679:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:0.0:1788830470.289832:0:6679:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:2.0:1788830470.294018:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257f805f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7644:x1875724595123840:12345-0@lo:5: Request processed in 13012us (13902us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1788830470.294031:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:1.0:1788830470.294332:0:7644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e257f804e00 x1875724595123840/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788830486 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788830470.294346:0:7644:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1788830470.294361:0:7644:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9e257f804e00 x1875724595123840/t4294967298(4294967298) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788830486 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788830470.294371:0:7644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257f804e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7644:1875724595123840:0@lo:5: 00000004:00080000:1.0:1788830470.294384:0:7644:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 10000000:01000000:2.0:1788830470.372071:0:5829:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788830470.372081:0:5829:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9e255d9b0800 from 5 10000000:01000000:2.0:1788830470.372086:0:5829:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788830470.372147:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.121@tcp lock: ffff9e257d80fc00/0x575506951eea0a9b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830470.372160:0:5829:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.121@tcp lock: ffff9e257d80fc00/0x575506951eea0a9b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830470.372172:0:5829:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.121@tcp lock: ffff9e257d80fc00/0x575506951eea0a9b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788830470.372199:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2566011c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1745cc3d-3952-4cd4-9020-9b8acb483105:5829:1875724595123968:0@lo:101: 00000100:00100000:2.0:1788830470.372280:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788830470.372328:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2565b949c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788830470.372832:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595123968 00000100:00100000:0.0:1788830470.372840:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595123968 00000100:00100000:0.0:1788830470.372905:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788830470.372915:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255d94b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1745cc3d-3952-4cd4-9020-9b8acb483105+18:5829:x1875724595123968:12345-0@lo:101: 00010000:00010000:0.0:1788830470.372932:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788830470.372948:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2445b7f200/0x575506951eea0aa2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x575506951eea0a9b expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830470.372977:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2445b7f200/0x575506951eea0aa2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x575506951eea0a9b expref: 19 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830470.372988:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2445b7f200/0x575506951eea0aa2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x575506951eea0a9b expref: 19 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830470.373021:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2445b7f200, rc 0) 00000100:00100000:0.0:1788830470.373081:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255d94b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1745cc3d-3952-4cd4-9020-9b8acb483105+19:5829:x1875724595123968:12345-0@lo:101: Request processed in 166us (800us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830470.373089:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788830470.373827:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2566011c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1745cc3d-3952-4cd4-9020-9b8acb483105:5829:1875724595123968:0@lo:101: 00010000:00010000:0.0:1788830470.373849:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.121@tcp lock: ffff9e257d80fc00/0x575506951eea0a9b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea0aa2 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830470.373861:0:5829:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.121@tcp lock: ffff9e257d80fc00/0x575506951eea0a9b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x575506951eea0aa2 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788830470.373930:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25479a3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1745cc3d-3952-4cd4-9020-9b8acb483105:5829:1875724595124096:0@lo:256: 00000100:00100000:0.0:1788830470.373975:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830470.374059:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2545cc9780 going to sleep for 11 seconds 00000100:00100000:2.0:1788830470.385246:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595124096 00000100:00100000:2.0:1788830470.385272:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595124096 00000100:00100000:2.0:1788830470.386790:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788830470.386807:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255d94a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1745cc3d-3952-4cd4-9020-9b8acb483105+19:5829:x1875724595124096:12345-0@lo:256: 20000000:01000000:2.0:1788830470.386844:0:5826:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788830470.386860:0:5826:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788830470.386863:0:5826:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:2.0:1788830470.387011:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255d94a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1745cc3d-3952-4cd4-9020-9b8acb483105+19:5829:x1875724595124096:12345-0@lo:256: Request processed in 210us (13035us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830470.387019:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788830470.389289:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25479a3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1745cc3d-3952-4cd4-9020-9b8acb483105:5829:1875724595124096:0@lo:256: 10000000:01000000:0.0:1788830470.389386:0:5829:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.121@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788830470.389398:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: ffff9e257d80fc00/0x575506951eea0a9b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea0aa2 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830470.389408:0:5829:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.121@tcp lock: ffff9e257d80fc00/0x575506951eea0a9b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea0aa2 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:02000400:0.0:1788830470.845604:0:7987:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg121-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788830471.200920:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788830472.219898:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788830473.243887:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788830473.953054:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2566011c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875724595124224:0@lo:13: 00000100:00100000:2.0:1788830473.953137:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788830473.956818:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595124224 00000100:00100000:2.0:1788830473.956834:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595124224 00000100:00100000:2.0:1788830473.956922:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788830473.956932:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2566011180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875724595124224:12345-0@lo:13: 00002000:00000024:2.0:1788830473.956970:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788830473.957053:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2566011180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875724595124224:12345-0@lo:13: Request processed in 123us (3917us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830473.957060:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1788830473.957113:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e2566011c00 x1875724595124224/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788830489 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788830473.957133:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2566011c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875724595124224:0@lo:13: 00000100:00080000:3.0:1788830473.957291:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788830474.267876:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788830474.972133:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257e924700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1745cc3d-3952-4cd4-9020-9b8acb483105:3307:1875724595124352:0@lo:400: 00000100:00100000:0.0:1788830474.972223:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830474.972283:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25472fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1875724595124864:0@lo:400: 00000100:00100000:0.0:1788830474.972315:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830474.972340:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788830474.972345:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257e926300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875724595124480:0@lo:400: 00000100:00100000:0.0:1788830474.972363:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830474.972374:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25472fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875724595124992:0@lo:400: 00000100:00100000:0.0:1788830474.972394:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830474.972424:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595124864 00000100:00100000:0.0:1788830474.972431:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595124864 00000100:00100000:0.0:1788830474.972477:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595124480 00000100:00100000:0.0:1788830474.972479:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595124480 00000100:00100000:0.0:1788830474.972493:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788830474.972500:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25479a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875724595124864:12345-0@lo:400: 00000100:00100000:0.0:1788830474.972560:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25479a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875724595124864:12345-0@lo:400: Request processed in 60us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830474.972567:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788830474.972583:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788830474.972589:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25479a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875724595124480:12345-0@lo:400: 00000100:00100000:0.0:1788830474.972621:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25479a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875724595124480:12345-0@lo:400: Request processed in 32us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830474.972626:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788830474.972645:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595124992 00000100:00100000:0.0:1788830474.972647:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595124992 00000100:00100000:0.0:1788830474.972671:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788830474.972676:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25479a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3307:x1875724595124992:12345-0@lo:400: 00000100:00100000:0.0:1788830474.972701:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25479a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3307:x1875724595124992:12345-0@lo:400: Request processed in 26us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830474.972743:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1788830474.972759:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788830474.972763:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788830474.972793:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e257e926300 x1875724595124480/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788830490 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788830474.972807:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257e926300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875724595124480:0@lo:400: 00010000:00080000:0.0:1788830474.972818:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e25472fe680 x1875724595124992/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788830490 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788830474.972827:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25472fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875724595124992:0@lo:400: 00010000:00080000:0.0:1788830474.972835:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e25472fd500 x1875724595124864/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788830490 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788830474.972843:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25472fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1875724595124864:0@lo:400: 00000100:00100000:1.0:1788830474.973000:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595124352 00000100:00100000:1.0:1788830474.973005:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595124352 00000100:00100000:1.0:1788830474.973032:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788830474.973039:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255d949850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+19:3307:x1875724595124352:12345-0@lo:400: 00000100:00100000:1.0:1788830474.973074:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255d949850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+19:3307:x1875724595124352:12345-0@lo:400: Request processed in 36us (852us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830474.973080:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788830474.973463:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257e924700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1745cc3d-3952-4cd4-9020-9b8acb483105:3307:1875724595124352:0@lo:400: 00000100:00100000:0.0:1788830474.974663:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25472fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1875724595124736:0@lo:400: 00000100:00100000:0.0:1788830474.974751:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830474.974789:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788830474.974795:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25472ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875724595124608:0@lo:400: 00000100:00100000:0.0:1788830474.974820:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830474.975002:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595124736 00000100:00100000:1.0:1788830474.975010:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595124736 00000100:00100000:1.0:1788830474.975057:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788830474.975066:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25479a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875724595124736:12345-0@lo:400: 00000100:00100000:1.0:1788830474.975118:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25479a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875724595124736:12345-0@lo:400: Request processed in 53us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830474.975125:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:0.0:1788830474.975259:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788830474.975288:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e25472fdc00 x1875724595124736/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788830490 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788830474.975303:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25472fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1875724595124736:0@lo:400: 00000100:00100000:3.0:1788830474.975901:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595124608 00000100:00100000:3.0:1788830474.975910:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595124608 00000100:00100000:3.0:1788830474.975959:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788830474.975968:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25479a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875724595124608:12345-0@lo:400: 00000100:00100000:3.0:1788830474.976079:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25479a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875724595124608:12345-0@lo:400: Request processed in 111us (1255us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830474.976087:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788830474.978957:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e25472ffb80 x1875724595124608/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788830490 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788830474.978976:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25472ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875724595124608:0@lo:400: 00010000:00010000:3.0:1788830475.297396:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788830475.485679:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257f804700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875724595125120:0@lo:13: 00000100:00100000:3.0:1788830475.485769:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830475.488796:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595125120 00000100:00100000:3.0:1788830475.488811:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595125120 00000100:00100000:3.0:1788830475.499973:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788830475.500004:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257f806a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1875724595125120:12345-0@lo:13: 00002000:00000024:3.0:1788830475.500050:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788830475.502838:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257f806a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1875724595125120:12345-0@lo:13: Request processed in 2834us (17055us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830475.503341:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1788830475.504487:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e257f804700 x1875724595125120/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788830491 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788830475.504514:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257f804700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875724595125120:0@lo:13: 00000001:00080000:2.0:1788830475.585912:0:7646:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:3.0:1788830476.316962:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788830476.595455:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830476.595814:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578324608 00000100:00100000:2.0:1788830476.595825:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578324608 00000100:00100000:2.0:1788830476.595873:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 112 00000100:00100000:2.0:1788830476.595882:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255d94b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2351:x1875724578324608:12345-192.168.201.21@tcp:250: 00010000:00080000:2.0:1788830476.595909:0:5826:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee@192.168.201.21@tcp t0 exp 0000000000000000 cur 229 last 0 00000020:00000080:2.0:1788830476.595936:0:5826:0:(genops.c:1385:class_connect()) connect: client 2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee, cookie 0x575506951eea0aa9 00000100:00080000:2.0:1788830476.596112:0:5826:0:(import.c:65:import_set_state_nolock()) ffff9e25475df800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788830476.596189:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255d94b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+5:2351:x1875724578324608:12345-192.168.201.21@tcp:250: Request processed in 306us (744us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830476.596197:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 112 00000100:00100000:3.0:1788830476.600907:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830476.600944:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578324736 00000100:00100000:3.0:1788830476.600954:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578324736 00000100:00100000:3.0:1788830476.601001:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 113 00000100:00100000:3.0:1788830476.601011:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255d94a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+5:5578:x1875724578324736:12345-192.168.201.21@tcp:101: 00010000:00010000:3.0:1788830476.601292:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788830476.601313:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e257d945800/0x575506951eea0ab0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xa578910534661b85 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830476.601348:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e257d945800/0x575506951eea0ab0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661b85 expref: 6 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830476.601360:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e257d945800/0x575506951eea0ab0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661b85 expref: 6 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830476.601370:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e257d945800, rc 0) 00000100:00100000:3.0:1788830476.601429:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255d94a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+6:5578:x1875724578324736:12345-192.168.201.21@tcp:101: Request processed in 418us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830476.601435:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 113 00000100:00100000:3.0:1788830476.621950:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830476.623181:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578324864 00000100:00100000:1.0:1788830476.623195:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578324864 00000100:00100000:1.0:1788830476.623275:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 114 00000100:00100000:1.0:1788830476.623286:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255d94bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+6:5578:x1875724578324864:12345-192.168.201.21@tcp:501: 00000100:00100000:1.0:1788830476.623678:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255d94bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+6:5578:x1875724578324864:12345-192.168.201.21@tcp:501: Request processed in 392us (1737us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788830476.623688:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 114 00000100:00100000:1.0:1788830476.631302:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830476.631421:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578324992 00000100:00100000:3.0:1788830476.631444:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578324992 00000100:00100000:3.0:1788830476.631509:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 115 00000100:00100000:3.0:1788830476.631520:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25474a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+6:5578:x1875724578324992:12345-192.168.201.21@tcp:101: 00010000:00010000:3.0:1788830476.631537:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788830476.631556:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e257d945a00/0x575506951eea0ab7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xa578910534661b8c expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830476.631587:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e257d945a00/0x575506951eea0ab7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661b8c expref: 7 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830476.631598:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e257d945a00/0x575506951eea0ab7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661b8c expref: 7 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830476.631607:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e257d945a00, rc 0) 00000100:00100000:3.0:1788830476.631669:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25474a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+7:5578:x1875724578324992:12345-192.168.201.21@tcp:101: Request processed in 151us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830476.631676:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 115 00000100:00100000:2.0:1788830476.634668:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830476.634782:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578325120 00000100:00100000:0.0:1788830476.634807:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578325120 00000100:00100000:0.0:1788830476.634868:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 116 00000100:00100000:0.0:1788830476.634878:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25474aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+7:5578:x1875724578325120:12345-192.168.201.21@tcp:501: 00000100:00100000:1.0:1788830476.659680:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25474aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+8:5578:x1875724578325120:12345-192.168.201.21@tcp:501: Request processed in 24785us (25004us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830476.659698:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 116 00000100:00100000:2.0:1788830476.670786:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830476.672783:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578325248 00000100:00100000:1.0:1788830476.672805:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578325248 00000100:00100000:1.0:1788830476.672911:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 117 00000100:00100000:1.0:1788830476.672924:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25474ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+8:5578:x1875724578325248:12345-192.168.201.21@tcp:503: 00000100:00100000:1.0:1788830476.673982:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25474ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+8:5578:x1875724578325248:12345-192.168.201.21@tcp:503: Request processed in 1050us (3201us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830476.673995:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 117 00000100:00100000:2.0:1788830476.696360:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830476.696486:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578325376 00000100:00100000:0.0:1788830476.696500:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578325376 00000100:00100000:0.0:1788830476.696569:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 118 00000100:00100000:0.0:1788830476.696580:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25474a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+8:5596:x1875724578325376:12345-192.168.201.21@tcp:502: 00000100:00100000:0.0:1788830476.697362:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25474a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+8:5596:x1875724578325376:12345-192.168.201.21@tcp:502: Request processed in 777us (1013us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830476.697375:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 118 00000100:00100000:2.0:1788830476.736844:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830476.737788:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578325504 00000100:00100000:1.0:1788830476.737803:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578325504 00000100:00100000:1.0:1788830476.737863:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 119 00000100:00100000:1.0:1788830476.737873:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25474aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+8:5596:x1875724578325504:12345-192.168.201.21@tcp:502: 00000100:00100000:1.0:1788830476.739017:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25474aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+8:5596:x1875724578325504:12345-192.168.201.21@tcp:502: Request processed in 1134us (2177us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830476.739030:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 119 00000100:00100000:0.0:1788830476.754610:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830476.754735:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578325632 00000100:00100000:1.0:1788830476.754748:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578325632 00000100:00100000:1.0:1788830476.754851:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 120 00000100:00100000:1.0:1788830476.754863:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25747bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+8:5578:x1875724578325632:12345-192.168.201.21@tcp:101: 00010000:00010000:1.0:1788830476.754883:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788830476.754905:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e25820fe000/0x575506951eea0abe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa578910534661bb6 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830476.754938:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e25820fe000/0x575506951eea0abe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661bb6 expref: 9 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830476.754951:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e25820fe000/0x575506951eea0abe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661bb6 expref: 9 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830476.754962:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e25820fe000, rc 0) 00000100:00100000:1.0:1788830476.755033:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25747bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+9:5578:x1875724578325632:12345-192.168.201.21@tcp:101: Request processed in 173us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830476.755040:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 120 00000100:00100000:2.0:1788830476.761824:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830476.763367:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578325760 00000100:00100000:1.0:1788830476.763398:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578325760 00000100:00100000:1.0:1788830476.763506:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 121 00000100:00100000:1.0:1788830476.763520:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25747bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+9:5578:x1875724578325760:12345-192.168.201.21@tcp:256: 20000000:01000000:1.0:1788830476.763555:0:5827:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788830476.763587:0:5827:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788830476.763592:0:5827:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788830476.763596:0:5827:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788830476.763599:0:5827:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:3.0:1788830476.773001:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25747bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+9:5578:x1875724578325760:12345-192.168.201.21@tcp:256: Request processed in 9465us (11172us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830476.773022:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 121 00000100:00100000:2.0:1788830476.782027:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830476.782119:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578325888 00000100:00100000:3.0:1788830476.782132:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578325888 00000100:00100000:3.0:1788830476.782210:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 122 00000100:00100000:3.0:1788830476.782222:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25747bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+9:5578:x1875724578325888:12345-192.168.201.21@tcp:101: 00010000:00010000:3.0:1788830476.782243:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788830476.782266:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e257d944000/0x575506951eea0ac5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa578910534661bbd expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830476.782445:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e257d944000/0x575506951eea0ac5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661bbd expref: 10 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830476.782462:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e257d944000/0x575506951eea0ac5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661bbd expref: 10 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830476.782473:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e257d944000, rc 0) 00000100:00100000:3.0:1788830476.782542:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25747bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+10:5578:x1875724578325888:12345-192.168.201.21@tcp:101: Request processed in 321us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830476.782550:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 122 00000100:00100000:2.0:1788830476.785637:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830476.786911:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578326016 00000100:00100000:3.0:1788830476.786930:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578326016 00000100:00100000:3.0:1788830476.787048:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 123 00000100:00100000:3.0:1788830476.787061:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25747bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+10:5578:x1875724578326016:12345-192.168.201.21@tcp:501: 00000100:00100000:3.0:1788830476.787434:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25747bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+10:5578:x1875724578326016:12345-192.168.201.21@tcp:501: Request processed in 374us (1809us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830476.787443:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 123 00000100:00100000:2.0:1788830476.792569:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830476.792646:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578326144 00000100:00100000:0.0:1788830476.792663:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578326144 00000100:00100000:0.0:1788830476.793202:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 124 00000100:00100000:0.0:1788830476.793223:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25747bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+10:5578:x1875724578326144:12345-192.168.201.21@tcp:503: 00000100:00100000:0.0:1788830476.793701:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25747bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+10:5578:x1875724578326144:12345-192.168.201.21@tcp:503: Request processed in 480us (1141us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830476.793732:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 124 00000100:00100000:2.0:1788830476.797381:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830476.797573:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578326272 00000100:00100000:1.0:1788830476.797587:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578326272 00000100:00100000:1.0:1788830476.797668:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 125 00000100:00100000:1.0:1788830476.797678:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25747bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+10:5600:x1875724578326272:12345-192.168.201.21@tcp:502: 00000100:00100000:1.0:1788830476.798008:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25747bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+10:5600:x1875724578326272:12345-192.168.201.21@tcp:502: Request processed in 331us (642us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830476.798017:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 125 00000100:00100000:2.0:1788830476.809034:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830476.809070:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578326400 00000100:00100000:2.0:1788830476.809079:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578326400 00000100:00100000:2.0:1788830476.809131:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 126 00000100:00100000:2.0:1788830476.809152:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25747bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+10:5600:x1875724578326400:12345-192.168.201.21@tcp:502: 00000100:00100000:2.0:1788830476.809388:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25747bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+10:5600:x1875724578326400:12345-192.168.201.21@tcp:502: Request processed in 248us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830476.809396:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 126 00000100:00100000:2.0:1788830476.813939:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830476.814035:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578326528 00000100:00100000:0.0:1788830476.814047:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578326528 00000100:00100000:0.0:1788830476.814106:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 4 00000100:00100000:0.0:1788830476.814116:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2566011c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2351:x1875724578326528:12345-192.168.201.21@tcp:38: 00010000:00080000:0.0:1788830476.814158:0:5833:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 1ef2fe7a-e5ec-4085-8326-b72aa00876cd@192.168.201.21@tcp t0 exp 0000000000000000 cur 230 last 0 00000020:00000080:0.0:1788830476.814214:0:5833:0:(genops.c:1385:class_connect()) connect: client 1ef2fe7a-e5ec-4085-8326-b72aa00876cd, cookie 0x575506951eea0acc 00000004:00100000:0.0:1788830476.814241:0:5833:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:0.0:1788830476.814247:0:5833:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:0.0:1788830476.870449:0:5833:0:(import.c:65:import_set_state_nolock()) ffff9e2446c81800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788830476.870569:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2566011c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+6:2351:x1875724578326528:12345-192.168.201.21@tcp:38: Request processed in 56450us (56640us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830476.870583:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 4 00010000:00010000:3.0:1788830477.339837:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788830477.878767:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830477.878908:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578326784 00000100:00100000:0.0:1788830477.878920:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578326784 00000100:00080000:3.0:1788830477.879119:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788830477.879193:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 5 00000100:00100000:0.0:1788830477.879206:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2566012300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+6:5578:x1875724578326784:12345-192.168.201.21@tcp:41: 00000004:00000024:0.0:1788830477.879249:0:5832:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1788830477.879368:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2566012300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+6:5578:x1875724578326784:12345-192.168.201.21@tcp:41: Request processed in 164us (610us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830477.881703:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830477.881848:0:5833:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1788830477.881860:0:5833:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1788830477.882408:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578326656 00000100:00100000:3.0:1788830477.882419:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578326656 00000100:00100000:0.0:1788830477.882816:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 5 00000100:00100000:3.0:1788830477.886397:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 6 00000100:00100000:3.0:1788830477.886418:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257f804700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+6:0:x1875724578326656:12345-192.168.201.21@tcp:41: 00000004:00000024:3.0:1788830477.886449:0:5833:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1788830477.892209:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257f804700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+6:0:x1875724578326656:12345-192.168.201.21@tcp:41: Request processed in 5784us (10502us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830477.892243:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 6 00000100:00100000:2.0:1788830477.892901:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830477.896674:0:8202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578326912 00000100:00100000:1.0:1788830477.896690:0:8202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578326912 00000100:00100000:1.0:1788830477.896774:0:8202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 7 00000100:00100000:1.0:1788830477.896785:0:8202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2566011880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+6:5578:x1875724578326912:12345-192.168.201.21@tcp:40: 00000100:00100000:1.0:1788830477.896882:0:8202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2566011880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+6:5578:x1875724578326912:12345-192.168.201.21@tcp:40: Request processed in 99us (3984us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830477.896890:0:8202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 7 00000100:00100000:2.0:1788830477.902833:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830477.902879:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830477.902908:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830477.902976:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830477.903020:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578327040 00000100:00100000:2.0:1788830477.903030:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578327040 00000100:00100000:2.0:1788830477.903065:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578327168 00000100:00100000:2.0:1788830477.903068:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578327168 00000100:00100000:2.0:1788830477.903083:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 10 00000100:00100000:2.0:1788830477.903091:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2566012a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2351:x1875724578327040:12345-192.168.201.21@tcp:8: 00010000:00080000:2.0:1788830477.903133:0:6679:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 1ef2fe7a-e5ec-4085-8326-b72aa00876cd@192.168.201.21@tcp t0 exp 0000000000000000 cur 231 last 0 00000020:00000080:2.0:1788830477.903169:0:6679:0:(genops.c:1385:class_connect()) connect: client 1ef2fe7a-e5ec-4085-8326-b72aa00876cd, cookie 0x575506951eea0ad3 00002000:00100000:2.0:1788830477.903182:0:6679:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 1ef2fe7a-e5ec-4085-8326-b72aa00876cd/ffff9e25475da800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113968 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788830477.903205:0:6679:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788830477.903542:0:6679:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788830477.903575:0:6679:0:(import.c:65:import_set_state_nolock()) ffff9e25475db000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788830477.903645:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2566012a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+6:2351:x1875724578327040:12345-192.168.201.21@tcp:8: Request processed in 553us (734us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830477.903652:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 10 00000100:00100000:2.0:1788830477.903672:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 11 00000100:00100000:2.0:1788830477.903676:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2566010a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2351:x1875724578327168:12345-192.168.201.21@tcp:8: 00010000:00080000:2.0:1788830477.903691:0:6679:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 1ef2fe7a-e5ec-4085-8326-b72aa00876cd@192.168.201.21@tcp t0 exp 0000000000000000 cur 231 last 0 00000020:00000080:2.0:1788830477.903743:0:6679:0:(genops.c:1385:class_connect()) connect: client 1ef2fe7a-e5ec-4085-8326-b72aa00876cd, cookie 0x575506951eea0ada 00002000:00100000:2.0:1788830477.903749:0:6679:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 1ef2fe7a-e5ec-4085-8326-b72aa00876cd/ffff9e25475dd000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113968 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788830477.903763:0:6679:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788830477.903958:0:6679:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788830477.903973:0:6679:0:(import.c:65:import_set_state_nolock()) ffff9e25475dc800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788830477.903998:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2566010a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+6:2351:x1875724578327168:12345-192.168.201.21@tcp:8: Request processed in 320us (1031us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830477.904014:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 11 00000100:00100000:3.0:1788830477.904559:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578327424 00000100:00100000:3.0:1788830477.904566:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578327424 00000100:00100000:3.0:1788830477.904609:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 0 00000100:00100000:3.0:1788830477.904617:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2566012d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+6:5578:x1875724578327424:12345-192.168.201.21@tcp:33: 00000100:00100000:0.0:1788830477.906956:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578327296 00000100:00100000:0.0:1788830477.906984:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578327296 00000100:00100000:0.0:1788830477.907047:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 127 00000100:00100000:0.0:1788830477.907057:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25747bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+10:2355:x1875724578327296:12345-192.168.201.21@tcp:400: 00000100:00100000:0.0:1788830477.907142:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25747bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+10:2355:x1875724578327296:12345-192.168.201.21@tcp:400: Request processed in 86us (4261us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830477.907150:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 127 00000004:00080000:3.0:1788830477.934781:0:5835:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 30106us 00000004:00200000:1.0:1788830477.958428:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1788830477.958570:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2566012d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+6:5578:x1875724578327424:12345-192.168.201.21@tcp:33: Request processed in 53948us (55752us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830477.958584:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 0 00000100:00100000:2.0:1788830478.141920:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830478.142036:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578327552 00000100:00100000:1.0:1788830478.142048:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578327552 00000100:00100000:1.0:1788830478.142113:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 8 00000100:00100000:1.0:1788830478.142134:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2566013480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+6:5617:x1875724578327552:12345-192.168.201.21@tcp:101: 00010000:00010000:1.0:1788830478.142155:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788830478.142200:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffc00/0x575506951eea0ae1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa578910534661be7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830478.142280:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea0ae8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830478.142326:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea0ae8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830478.142343:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea0ae8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788830478.142397:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788830478.142402:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788830478.142418:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea0ae8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830478.142445:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffc00/0x575506951eea0ae1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661be7 expref: 8 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830478.142464:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea0ae8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661be7 expref: 7 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830478.142472:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e257480c100) 00010000:00010000:1.0:1788830478.142475:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788830478.142478:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e25820ff800, rc 0) 00000100:00100000:1.0:1788830478.142547:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2566013480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+7:5617:x1875724578327552:12345-192.168.201.21@tcp:101: Request processed in 415us (649us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830478.142554:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 8 00010000:00010000:3.0:1788830478.364177:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788830479.068469:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2566011f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875724595125248:0@lo:13: 00000100:00100000:3.0:1788830479.068544:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788830479.068660:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595125248 00000100:00100000:2.0:1788830479.068667:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595125248 00000100:00100000:2.0:1788830479.068731:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788830479.068743:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257f807b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875724595125248:12345-0@lo:13: 00002000:00000024:2.0:1788830479.068763:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788830479.068809:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257f807b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875724595125248:12345-0@lo:13: Request processed in 69us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830479.068816:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1788830479.068851:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e2566011f80 x1875724595125248/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788830495 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788830479.068869:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2566011f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875724595125248:0@lo:13: 00000100:00080000:3.0:1788830479.068939:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788830479.388026:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788830479.698440:0:6709:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 1ef2fe7a-e5ec-4085-8326-b72aa00876cd 00000100:00100000:0.0:1788830480.092230:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25472ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1745cc3d-3952-4cd4-9020-9b8acb483105:3307:1875724595125376:0@lo:400: 00000100:00100000:0.0:1788830480.092308:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788830480.092492:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595125376 00000100:00100000:2.0:1788830480.092501:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595125376 00000100:00100000:2.0:1788830480.092568:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1788830480.092578:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e254812d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1745cc3d-3952-4cd4-9020-9b8acb483105+19:3307:x1875724595125376:12345-0@lo:400: 00000100:00100000:3.0:1788830480.092703:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25472fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875724595125504:0@lo:400: 00000100:00100000:3.0:1788830480.092753:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830480.092795:0:8202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595125504 00000100:00100000:3.0:1788830480.092799:0:8202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595125504 00000100:00100000:3.0:1788830480.092829:0:8202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788830480.092836:0:8202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257f804000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875724595125504:12345-0@lo:400: 00000100:00100000:3.0:1788830480.092874:0:8202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257f804000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875724595125504:12345-0@lo:400: Request processed in 38us (120us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830480.092881:0:8202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788830480.092924:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25472fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875724595125504:0@lo:400: 00000100:00100000:2.0:1788830480.095784:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e254812d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1745cc3d-3952-4cd4-9020-9b8acb483105+19:3307:x1875724595125376:12345-0@lo:400: Request processed in 3196us (3465us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830480.095801:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788830480.096875:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25472fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875724595126016:0@lo:400: 00000100:00100000:1.0:1788830480.096940:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830480.096985:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788830480.096990:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25472fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1875724595125888:0@lo:400: 00000100:00100000:1.0:1788830480.097015:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830480.097059:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595125888 00000100:00100000:1.0:1788830480.097067:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595125888 00000100:00100000:1.0:1788830480.097149:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788830480.097158:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25472ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875724595125888:12345-0@lo:400: 00000100:00100000:1.0:1788830480.097206:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25472ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875724595125888:12345-0@lo:400: Request processed in 49us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830480.097212:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:1.0:1788830480.097229:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788830480.097258:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25472fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1875724595125888:0@lo:400: 00000100:00100000:3.0:1788830480.097347:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25472fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875724595125632:0@lo:400: 00000100:00100000:3.0:1788830480.097378:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830480.097406:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788830480.097420:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25472ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875724595125760:0@lo:400: 00000100:00100000:3.0:1788830480.097445:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830480.097472:0:8202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595125760 00000100:00100000:3.0:1788830480.097476:0:8202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595125760 00000100:00100000:3.0:1788830480.097506:0:8202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788830480.097513:0:8202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257f805c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875724595125760:12345-0@lo:400: 00000100:00100000:3.0:1788830480.097563:0:8202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257f805c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875724595125760:12345-0@lo:400: Request processed in 50us (117us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830480.097569:0:8202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788830480.097598:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25472ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875724595125760:0@lo:400: 00000100:00100000:1.0:1788830480.097779:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595126016 00000100:00100000:1.0:1788830480.097783:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595126016 00000100:00100000:1.0:1788830480.097863:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595125632 00000100:00100000:1.0:1788830480.097867:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595125632 00000100:00100000:1.0:1788830480.097884:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788830480.097890:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25472fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875724595126016:12345-0@lo:400: 00000100:00100000:1.0:1788830480.097928:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25472fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875724595126016:12345-0@lo:400: Request processed in 38us (989us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830480.097935:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788830480.097947:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788830480.097952:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257f804380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875724595125632:12345-0@lo:400: 00000100:00100000:1.0:1788830480.098163:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257f804380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875724595125632:12345-0@lo:400: Request processed in 209us (783us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830480.098169:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1788830480.098186:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788830480.098189:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788830480.098210:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e25472fea00 x1875724595126016/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788830496 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788830480.098220:0:3308:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1788830480.098238:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25472fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875724595126016:0@lo:400: 00000100:00100000:0.0:1788830480.102163:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25472ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1745cc3d-3952-4cd4-9020-9b8acb483105:3307:1875724595125376:0@lo:400: 00010000:00080000:3.0:1788830480.102201:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e25472fdf80 x1875724595125632/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788830496 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788830480.102215:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25472fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875724595125632:0@lo:400: 00010000:00010000:3.0:1788830480.414454:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788830480.444120:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830480.445173:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578327680 00000100:00100000:1.0:1788830480.445185:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578327680 00000100:00100000:0.0:1788830480.446288:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 9 00000100:00100000:0.0:1788830480.446301:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2566011f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+7:5669:x1875724578327680:12345-192.168.201.21@tcp:41: 00000004:00000024:0.0:1788830480.446346:0:5834:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1788830480.446432:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2566011f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+7:5669:x1875724578327680:12345-192.168.201.21@tcp:41: Request processed in 133us (2326us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830480.446440:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 9 00000100:00080000:1.0:1788830480.447042:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788830480.467403:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830480.469561:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578327808 00000100:00100000:2.0:1788830480.469582:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578327808 00000100:00080000:1.0:1788830480.469773:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788830480.470178:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 8 00000100:00100000:2.0:1788830480.470194:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25479a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+5:5669:x1875724578327808:12345-192.168.201.21@tcp:13: 00002000:00000024:2.0:1788830480.470243:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788830480.470390:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25479a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+5:5669:x1875724578327808:12345-192.168.201.21@tcp:13: Request processed in 200us (2997us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830480.470399:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 8 00000100:00100000:0.0:1788830480.474998:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830480.475194:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578327936 00000100:00100000:3.0:1788830480.475205:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578327936 00000100:00100000:3.0:1788830480.475327:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 9 00000100:00100000:3.0:1788830480.475336:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25479a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+6:5669:x1875724578327936:12345-192.168.201.21@tcp:13: 00002000:00000024:3.0:1788830480.475376:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788830480.475467:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25479a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+6:5669:x1875724578327936:12345-192.168.201.21@tcp:13: Request processed in 131us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830480.475474:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 9 00000100:00080000:1.0:1788830480.479268:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788830480.611649:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788830480.611679:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25472fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875724595126144:0@lo:13: 00000100:00100000:3.0:1788830480.611812:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830480.612972:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595126144 00000100:00100000:1.0:1788830480.612985:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595126144 00000100:00100000:1.0:1788830480.613060:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788830480.613071:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257f806680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875724595126144:12345-0@lo:13: 00002000:00000024:1.0:1788830480.613109:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788830480.613189:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257f806680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875724595126144:12345-0@lo:13: Request processed in 120us (1377us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830480.613196:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:0.0:1788830480.613310:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e25472fea00 x1875724595126144/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788830496 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788830480.613331:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25472fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875724595126144:0@lo:13: 00010000:00010000:3.0:1788830481.436999:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788830482.227366:0:5855:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 1ef2fe7a-e5ec-4085-8326-b72aa00876cd 00010000:00010000:3.0:1788830482.461388:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788830482.710250:0:7646:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 1ef2fe7a-e5ec-4085-8326-b72aa00876cd 00000001:02000400:3.0:1788830483.028304:0:8294:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:0.0:1788830483.334586:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830483.334634:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830483.334672:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830483.334742:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830483.334774:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578328320 00000100:00100000:0.0:1788830483.334783:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578328320 00000100:00100000:0.0:1788830483.334840:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578328448 00000100:00100000:0.0:1788830483.334843:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578328448 00000100:00100000:0.0:1788830483.334863:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 6 00000100:00100000:0.0:1788830483.334873:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257e924700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+5:2352:x1875724578328320:12345-192.168.201.21@tcp:400: 00000100:00100000:0.0:1788830483.334957:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257e924700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+5:2352:x1875724578328320:12345-192.168.201.21@tcp:400: Request processed in 85us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830483.334966:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 6 00000100:00100000:0.0:1788830483.334983:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 7 00000100:00100000:0.0:1788830483.334990:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257e926300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+5:2353:x1875724578328448:12345-192.168.201.21@tcp:400: 00000100:00100000:0.0:1788830483.335016:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257e926300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+5:2353:x1875724578328448:12345-192.168.201.21@tcp:400: Request processed in 27us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830483.335052:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 7 00000100:00080000:0.0:1788830483.335071:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788830483.335075:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788830483.335079:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578328064 00000100:00100000:2.0:1788830483.335084:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578328064 00000100:00100000:2.0:1788830483.335113:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 129 00000100:00100000:2.0:1788830483.335119:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e254812d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+10:2352:x1875724578328064:12345-192.168.201.21@tcp:400: 00000100:00100000:2.0:1788830483.335145:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e254812d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+10:2352:x1875724578328064:12345-192.168.201.21@tcp:400: Request processed in 27us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830483.335152:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 129 00000100:00100000:3.0:1788830483.335237:0:8202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578328192 00000100:00100000:3.0:1788830483.335242:0:8202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578328192 00000100:00100000:3.0:1788830483.335291:0:8202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 17 00000100:00100000:3.0:1788830483.335299:0:8202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25479a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+6:2353:x1875724578328192:12345-192.168.201.21@tcp:400: 00000100:00100000:3.0:1788830483.335343:0:8202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25479a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+6:2353:x1875724578328192:12345-192.168.201.21@tcp:400: Request processed in 45us (766us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830483.335350:0:8202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 17 00000100:00080000:0.0:1788830483.336039:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788830483.484414:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788830484.187931:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2566012680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875724595126272:0@lo:13: 00000100:00100000:0.0:1788830484.188066:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830484.188209:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595126272 00000100:00100000:1.0:1788830484.188225:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595126272 00000100:00100000:1.0:1788830484.188332:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788830484.188345:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257fa67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875724595126272:12345-0@lo:13: 00002000:00000024:1.0:1788830484.188401:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788830484.188492:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257fa67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875724595126272:12345-0@lo:13: Request processed in 150us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830484.188500:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:1.0:1788830484.188560:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e2566012680 x1875724595126272/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788830500 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788830484.188584:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2566012680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875724595126272:0@lo:13: 00000100:00080000:0.0:1788830484.188845:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788830484.507864:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788830485.212160:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257f726d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875724595126528:0@lo:400: 00000100:00100000:1.0:1788830485.212270:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830485.212362:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257f725180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875724595127040:0@lo:400: 00000100:00100000:1.0:1788830485.212391:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830485.212425:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788830485.212431:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257f804e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1745cc3d-3952-4cd4-9020-9b8acb483105:3308:1875724595126400:0@lo:400: 00000100:00100000:1.0:1788830485.212460:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830485.212484:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257f725880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1875724595126912:0@lo:400: 00000100:00100000:1.0:1788830485.212505:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830485.212534:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257f727800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875724595126656:0@lo:400: 00000100:00100000:1.0:1788830485.212556:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830485.212572:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788830485.212576:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257f724700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875724595126784:0@lo:400: 00000100:00100000:1.0:1788830485.212593:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830485.212628:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595126400 00000100:00100000:1.0:1788830485.212637:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595126400 00000100:00100000:1.0:1788830485.212705:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1788830485.212751:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e254812f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1745cc3d-3952-4cd4-9020-9b8acb483105+19:3308:x1875724595126400:12345-0@lo:400: 00000100:00100000:1.0:1788830485.212811:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e254812f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1745cc3d-3952-4cd4-9020-9b8acb483105+19:3308:x1875724595126400:12345-0@lo:400: Request processed in 61us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830485.212819:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1788830485.212857:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595126528 00000100:00100000:1.0:1788830485.212862:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595126528 00000100:00100000:1.0:1788830485.212903:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595126912 00000100:00100000:1.0:1788830485.212907:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595126912 00000100:00100000:1.0:1788830485.212930:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595126784 00000100:00100000:1.0:1788830485.212932:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595126784 00000100:00100000:1.0:1788830485.212947:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788830485.212953:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25472fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875724595126528:12345-0@lo:400: 00000100:00100000:1.0:1788830485.212987:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25472fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875724595126528:12345-0@lo:400: Request processed in 34us (717us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830485.213013:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788830485.213027:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788830485.213034:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25472fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875724595126912:12345-0@lo:400: 00000100:00100000:1.0:1788830485.213067:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25472fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875724595126912:12345-0@lo:400: Request processed in 34us (561us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830485.213072:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788830485.213083:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788830485.213088:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25472ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875724595126784:12345-0@lo:400: 00000100:00100000:1.0:1788830485.213118:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25472ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875724595126784:12345-0@lo:400: Request processed in 30us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830485.213125:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788830485.213179:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257f724700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875724595126784:0@lo:400: 00000100:00100000:1.0:1788830485.213209:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257f804e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1745cc3d-3952-4cd4-9020-9b8acb483105:3308:1875724595126400:0@lo:400: 00000100:00100000:1.0:1788830485.213219:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257f725880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1875724595126912:0@lo:400: 00000100:00100000:1.0:1788830485.213229:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257f726d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875724595126528:0@lo:400: 00000100:00100000:0.0:1788830485.213676:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595127040 00000100:00100000:0.0:1788830485.213694:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595127040 00000100:00100000:0.0:1788830485.213761:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595126656 00000100:00100000:0.0:1788830485.213764:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595126656 00000100:00100000:0.0:1788830485.213782:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788830485.213790:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25472fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875724595127040:12345-0@lo:400: 00000100:00100000:0.0:1788830485.213846:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25472fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875724595127040:12345-0@lo:400: Request processed in 56us (1453us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830485.213853:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788830485.213882:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788830485.213890:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25472fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875724595126656:12345-0@lo:400: 00000100:00100000:0.0:1788830485.213926:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25472fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875724595126656:12345-0@lo:400: Request processed in 38us (1369us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830485.213932:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:0.0:1788830485.213955:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788830485.213960:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788830485.213988:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e257f727800 x1875724595126656/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788830501 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788830485.214015:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257f727800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875724595126656:0@lo:400: 00010000:00080000:0.0:1788830485.214047:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e257f725180 x1875724595127040/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788830501 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788830485.214071:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257f725180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875724595127040:0@lo:400: 00010000:00010000:2.0:1788830485.532484:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788830485.725256:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788830485.725295:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25472fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875724595127168:0@lo:13: 00000100:00100000:1.0:1788830485.725396:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830485.725483:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595127168 00000100:00100000:1.0:1788830485.725494:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595127168 00000100:00100000:1.0:1788830485.725555:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788830485.725567:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25472fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875724595127168:12345-0@lo:13: 00002000:00000024:1.0:1788830485.725631:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788830485.725685:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25472fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875724595127168:12345-0@lo:13: Request processed in 119us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830485.725700:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:1.0:1788830485.725772:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e25472fc380 x1875724595127168/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788830501 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788830485.725794:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25472fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875724595127168:0@lo:13: 00010000:00010000:3.0:1788830486.556027:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788830486.711672:0:8442:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdae119730 20000000:00000080:2.0:1788830486.711691:0:8442:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9e257fa94000 uarg=0000000000000000 20000000:01000000:2.0:1788830486.711912:0:8442:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:2.0:1788830486.711916:0:8442:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:2.0:1788830486.711919:0:8442:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:2.0:1788830486.711923:0:8442:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:2.0:1788830486.711928:0:8442:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:2.0:1788830486.711942:0:8442:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1788830486.711944:0:8442:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1788830486.712142:0:8442:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1788830486.712145:0:8442:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788830486.713275:0:8443:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:2.0:1788830486.714287:0:8442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:2.0:1788830486.714432:0:8442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:2.0:1788830486.714495:0:8442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:2.0:1788830486.714509:0:8442:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1788830486.714511:0:8442:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788830486.715447:0:8444:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:2.0:1788830486.716129:0:8442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:2.0:1788830486.716198:0:8442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:2.0:1788830486.716240:0:8442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:2.0:1788830486.716252:0:8442:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788830486.716254:0:8442:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788830486.717495:0:8445:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:2.0:1788830486.718191:0:8442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:2.0:1788830486.718244:0:8442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:2.0:1788830486.718284:0:8442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:2.0:1788830486.718296:0:8442:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1788830486.718299:0:8442:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788830486.719544:0:8446:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:2.0:1788830486.720139:0:8442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:2.0:1788830486.720203:0:8442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:2.0:1788830486.720241:0:8442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 10000000:01000000:2.0:1788830486.720257:0:8442:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1788830486.720280:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2565728a00/0x575506951eea0aef lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830486.720300:0:8442:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e25820fea00/0x575506951eea09ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x575506951eea09e5 expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830486.720309:0:8442:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2540031c00/0x575506951eea0a16 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x575506951eea0a0f expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830486.720316:0:8442:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e257d80e200/0x575506951eea0a39 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x575506951eea0a32 expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830486.720323:0:8442:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2540031e00/0x575506951eea0a47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x575506951eea0a40 expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830486.720407:0:8442:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2445b7e200/0x575506951eea0a55 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x575506951eea0a4e expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830486.720414:0:8442:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2445b7e400/0x575506951eea0a63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x575506951eea0a5c expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830486.720428:0:8442:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e257d80e600/0x575506951eea0a86 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x575506951eea0a7f expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830486.720437:0:8442:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e257d945800/0x575506951eea0ab0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661b85 expref: 9 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830486.720444:0:8442:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e257d945a00/0x575506951eea0ab7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661b8c expref: 9 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830486.720452:0:8442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2565728a00/0x575506951eea0aef lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830486.720493:0:8442:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e257d945a00/0x575506951eea0ab7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.201.21@tcp remote: 0xa578910534661b8c expref: 9 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830486.720510:0:8442:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e257d945a00/0x575506951eea0ab7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661b8c expref: 9 pid: 5826 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788830486.720525:0:8442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2566011500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8442:1875724595127296:192.168.201.21@tcp:104: 00010000:00010000:2.0:1788830486.720688:0:8442:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e257d945800/0x575506951eea0ab0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.201.21@tcp remote: 0xa578910534661b85 expref: 9 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830486.720697:0:8442:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e257d945800/0x575506951eea0ab0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661b85 expref: 9 pid: 5827 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788830486.720744:0:8442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2566012680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8442:1875724595127424:192.168.201.21@tcp:104: 00010000:00010000:2.0:1788830486.720876:0:8442:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e257d80e600/0x575506951eea0a86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x575506951eea0a7f expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830486.720896:0:8442:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e257d80e600/0x575506951eea0a86 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x575506951eea0a7f expref: 18 pid: 5824 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788830486.720906:0:8442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e255005fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8442:1875724595127552:0@lo:104: 00000100:00100000:2.0:1788830486.720954:0:8442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788830486.721003:0:8442:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2445b7e400/0x575506951eea0a63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x575506951eea0a5c expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830486.721012:0:8442:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e2445b7e400/0x575506951eea0a63 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x575506951eea0a5c expref: 18 pid: 5826 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788830486.721020:0:8442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e255005dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8442:1875724595127680:0@lo:104: 00010000:00010000:2.0:1788830486.721048:0:8442:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2445b7e200/0x575506951eea0a55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x575506951eea0a4e expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830486.721056:0:8442:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e2445b7e200/0x575506951eea0a55 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x575506951eea0a4e expref: 18 pid: 5824 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788830486.721064:0:8442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e255005d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8442:1875724595127808:0@lo:104: 00010000:00010000:2.0:1788830486.721086:0:8442:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2540031e00/0x575506951eea0a47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x575506951eea0a40 expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830486.721093:0:8442:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e2540031e00/0x575506951eea0a47 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x575506951eea0a40 expref: 18 pid: 5824 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788830486.721100:0:8442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e255005e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8442:1875724595127936:0@lo:104: 00010000:00010000:2.0:1788830486.721121:0:8442:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e257d80e200/0x575506951eea0a39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x575506951eea0a32 expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830486.721141:0:8442:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e257d80e200/0x575506951eea0a39 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x575506951eea0a32 expref: 18 pid: 5824 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788830486.721149:0:8442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e255005ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8442:1875724595128064:0@lo:104: 00010000:00010000:2.0:1788830486.721175:0:8442:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2540031c00/0x575506951eea0a16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x575506951eea0a0f expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830486.721183:0:8442:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e2540031c00/0x575506951eea0a16 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x575506951eea0a0f expref: 18 pid: 5827 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788830486.721191:0:8442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e255005df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8442:1875724595128192:0@lo:104: 00010000:00010000:2.0:1788830486.721210:0:8442:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e25820fea00/0x575506951eea09ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x575506951eea09e5 expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830486.721217:0:8442:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e25820fea00/0x575506951eea09ec lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x575506951eea09e5 expref: 18 pid: 5824 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788830486.721223:0:8442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e255005f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8442:1875724595128320:0@lo:104: 00000100:00100000:2.0:1788830486.721239:0:8442:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2574753cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788830486.721324:0:5816:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788830486.721342:0:5816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830486.721364:0:5816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830486.721372:0:5816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830486.721380:0:5816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830486.721387:0:5816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830486.721395:0:5816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830486.721403:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595127552 00000100:00100000:1.0:1788830486.721409:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595127552 00000100:00100000:1.0:1788830486.721451:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595127680 00000100:00100000:1.0:1788830486.721454:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595127680 00000100:00100000:1.0:1788830486.721463:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595127808 00000100:00100000:1.0:1788830486.721465:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595127808 00000100:00100000:1.0:1788830486.721473:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595127936 00000100:00100000:1.0:1788830486.721474:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595127936 00000100:00100000:1.0:1788830486.721482:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595128064 00000100:00100000:1.0:1788830486.721484:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595128064 00000100:00100000:1.0:1788830486.721492:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595128192 00000100:00100000:1.0:1788830486.721494:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595128192 00000100:00100000:1.0:1788830486.721502:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595128320 00000100:00100000:1.0:1788830486.721504:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595128320 00000100:00100000:1.0:1788830486.721518:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788830486.721526:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2444aa3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1745cc3d-3952-4cd4-9020-9b8acb483105+9:8442:x1875724595127552:12345-0@lo:104: 00010000:00010000:1.0:1788830486.721544:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.121@tcp lock: ffff9e2445b7fa00/0x575506951eea0a7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x575506951eea0a86 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830486.721606:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788830486.721613:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2444aa3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1745cc3d-3952-4cd4-9020-9b8acb483105+9:8442:x1875724595127552:12345-0@lo:104: Request processed in 87us (659us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830486.721620:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788830486.721678:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788830486.721686:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25472fc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1745cc3d-3952-4cd4-9020-9b8acb483105+8:8442:x1875724595127680:12345-0@lo:104: 00010000:00010000:1.0:1788830486.721693:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.121@tcp lock: ffff9e2445b7fe00/0x575506951eea0a5c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x575506951eea0a63 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830486.721750:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788830486.721755:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25472fc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1745cc3d-3952-4cd4-9020-9b8acb483105+8:8442:x1875724595127680:12345-0@lo:104: Request processed in 72us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830486.721761:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788830486.721773:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788830486.721779:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25472fc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1745cc3d-3952-4cd4-9020-9b8acb483105+7:8442:x1875724595127808:12345-0@lo:104: 00010000:00010000:1.0:1788830486.721800:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.121@tcp lock: ffff9e2445b7fc00/0x575506951eea0a4e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x575506951eea0a55 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830486.721828:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788830486.721832:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25472fc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1745cc3d-3952-4cd4-9020-9b8acb483105+7:8442:x1875724595127808:12345-0@lo:104: Request processed in 55us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830486.721839:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788830486.721851:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788830486.721856:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25472fea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1745cc3d-3952-4cd4-9020-9b8acb483105+6:8442:x1875724595127936:12345-0@lo:104: 00010000:00010000:1.0:1788830486.721870:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.121@tcp lock: ffff9e2540031200/0x575506951eea0a40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x575506951eea0a47 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830486.721897:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1788830486.721902:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25472fea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1745cc3d-3952-4cd4-9020-9b8acb483105+6:8442:x1875724595127936:12345-0@lo:104: Request processed in 46us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830486.721908:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788830486.721921:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788830486.721927:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25472fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1745cc3d-3952-4cd4-9020-9b8acb483105+5:8442:x1875724595128064:12345-0@lo:104: 00010000:00010000:1.0:1788830486.721935:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.121@tcp lock: ffff9e257d945c00/0x575506951eea0a32 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x575506951eea0a39 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830486.721960:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:1.0:1788830486.721964:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25472fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1745cc3d-3952-4cd4-9020-9b8acb483105+5:8442:x1875724595128064:12345-0@lo:104: Request processed in 39us (584us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830486.721980:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788830486.721993:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788830486.722000:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25472ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1745cc3d-3952-4cd4-9020-9b8acb483105+4:8442:x1875724595128192:12345-0@lo:104: 00010000:00010000:1.0:1788830486.722007:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.121@tcp lock: ffff9e257d945400/0x575506951eea0a0f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x575506951eea0a16 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830486.722031:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:1.0:1788830486.722036:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25472ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1745cc3d-3952-4cd4-9020-9b8acb483105+4:8442:x1875724595128192:12345-0@lo:104: Request processed in 38us (647us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830486.722041:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788830486.722052:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788830486.722058:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25472ff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1745cc3d-3952-4cd4-9020-9b8acb483105+3:8442:x1875724595128320:12345-0@lo:104: 00010000:00010000:1.0:1788830486.722071:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.121@tcp lock: ffff9e257d945200/0x575506951eea09e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x575506951eea09ec expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830486.722099:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:1.0:1788830486.722104:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25472ff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1745cc3d-3952-4cd4-9020-9b8acb483105+3:8442:x1875724595128320:12345-0@lo:104: Request processed in 47us (707us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830486.722110:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00010000:1.0:1788830486.722131:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:1.0:1788830486.722138:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.121@tcp lock: ffff9e2445b7fa00/0x575506951eea0a7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x575506951eea0a86 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830486.722146:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2445b7fa00 already unused, calling callback (ffffffffc1aebc20) 10000000:00010000:1.0:1788830486.722151:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.121@tcp lock: ffff9e2445b7fa00/0x575506951eea0a7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x575506951eea0a86 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830486.722159:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.121@tcp lock: ffff9e2445b7fa00/0x575506951eea0a7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x575506951eea0a86 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788830486.722165:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.121@tcp lock: ffff9e2445b7fa00/0x575506951eea0a7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x575506951eea0a86 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788830486.722171:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788830486.722207:0:5820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.121@tcp lock: ffff9e2445b7fa00/0x575506951eea0a7f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x575506951eea0a86 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830486.722213:0:5820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788830486.722234:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.121@tcp lock: ffff9e2445b7fa00/0x575506951eea0a7f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x575506951eea0a86 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830486.722240:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.121@tcp lock: ffff9e2445b7fa00/0x575506951eea0a7f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x575506951eea0a86 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830486.722261:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1788830486.722265:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.121@tcp lock: ffff9e2445b7fe00/0x575506951eea0a5c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x575506951eea0a63 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830486.722271:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2445b7fe00 already unused, calling callback (ffffffffc1aebc20) 10000000:00010000:1.0:1788830486.722273:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.121@tcp lock: ffff9e2445b7fe00/0x575506951eea0a5c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x575506951eea0a63 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830486.722280:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.121@tcp lock: ffff9e2445b7fe00/0x575506951eea0a5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x575506951eea0a63 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788830486.722286:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.121@tcp lock: ffff9e2445b7fe00/0x575506951eea0a5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x575506951eea0a63 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788830486.722290:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788830486.722305:0:5820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.121@tcp lock: ffff9e2445b7fe00/0x575506951eea0a5c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x575506951eea0a63 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830486.722311:0:5820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788830486.722325:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.121@tcp lock: ffff9e2445b7fe00/0x575506951eea0a5c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x575506951eea0a63 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830486.722332:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.121@tcp lock: ffff9e2445b7fe00/0x575506951eea0a5c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x575506951eea0a63 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830486.722341:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1788830486.722345:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.121@tcp lock: ffff9e2445b7fc00/0x575506951eea0a4e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x575506951eea0a55 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830486.722360:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2445b7fc00 already unused, calling callback (ffffffffc1aebc20) 10000000:00010000:1.0:1788830486.722363:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.121@tcp lock: ffff9e2445b7fc00/0x575506951eea0a4e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x575506951eea0a55 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830486.722370:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.121@tcp lock: ffff9e2445b7fc00/0x575506951eea0a4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x575506951eea0a55 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788830486.722375:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.121@tcp lock: ffff9e2445b7fc00/0x575506951eea0a4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x575506951eea0a55 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788830486.722380:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788830486.722396:0:5820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.121@tcp lock: ffff9e2445b7fc00/0x575506951eea0a4e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x575506951eea0a55 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830486.722402:0:5820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788830486.722408:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.121@tcp lock: ffff9e2445b7fc00/0x575506951eea0a4e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x575506951eea0a55 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830486.722413:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.121@tcp lock: ffff9e2445b7fc00/0x575506951eea0a4e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x575506951eea0a55 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830486.722421:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788830486.722424:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.121@tcp lock: ffff9e2540031200/0x575506951eea0a40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x575506951eea0a47 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830486.722430:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2540031200 already unused, calling callback (ffffffffc1aebc20) 10000000:00010000:1.0:1788830486.722432:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.121@tcp lock: ffff9e2540031200/0x575506951eea0a40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x575506951eea0a47 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830486.722448:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.121@tcp lock: ffff9e2540031200/0x575506951eea0a40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x575506951eea0a47 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788830486.722453:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.121@tcp lock: ffff9e2540031200/0x575506951eea0a40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x575506951eea0a47 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788830486.722458:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788830486.722471:0:5820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.121@tcp lock: ffff9e2540031200/0x575506951eea0a40 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x575506951eea0a47 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830486.722477:0:5820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788830486.722482:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.121@tcp lock: ffff9e2540031200/0x575506951eea0a40 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x575506951eea0a47 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830486.722487:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.121@tcp lock: ffff9e2540031200/0x575506951eea0a40 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x575506951eea0a47 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830486.722497:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788830486.722500:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.121@tcp lock: ffff9e257d945c00/0x575506951eea0a32 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x575506951eea0a39 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830486.722505:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e257d945c00 already unused, calling callback (ffffffffc1aebc20) 10000000:00010000:1.0:1788830486.722508:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.121@tcp lock: ffff9e257d945c00/0x575506951eea0a32 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x575506951eea0a39 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830486.722514:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.121@tcp lock: ffff9e257d945c00/0x575506951eea0a32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x575506951eea0a39 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788830486.722519:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.121@tcp lock: ffff9e257d945c00/0x575506951eea0a32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x575506951eea0a39 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788830486.722531:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788830486.722544:0:5820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.121@tcp lock: ffff9e257d945c00/0x575506951eea0a32 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x575506951eea0a39 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830486.722549:0:5820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788830486.722553:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.121@tcp lock: ffff9e257d945c00/0x575506951eea0a32 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x575506951eea0a39 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830486.722559:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.121@tcp lock: ffff9e257d945c00/0x575506951eea0a32 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x575506951eea0a39 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830486.722569:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788830486.722571:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.121@tcp lock: ffff9e257d945400/0x575506951eea0a0f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x575506951eea0a16 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830486.722576:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e257d945400 already unused, calling callback (ffffffffc1aebc20) 10000000:00010000:1.0:1788830486.722579:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.121@tcp lock: ffff9e257d945400/0x575506951eea0a0f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x575506951eea0a16 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830486.722584:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.121@tcp lock: ffff9e257d945400/0x575506951eea0a0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x575506951eea0a16 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788830486.722589:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.121@tcp lock: ffff9e257d945400/0x575506951eea0a0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x575506951eea0a16 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788830486.722594:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788830486.722603:0:5820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.121@tcp lock: ffff9e257d945400/0x575506951eea0a0f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x575506951eea0a16 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830486.722608:0:5820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788830486.722617:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.121@tcp lock: ffff9e257d945400/0x575506951eea0a0f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x575506951eea0a16 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830486.722624:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.121@tcp lock: ffff9e257d945400/0x575506951eea0a0f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x575506951eea0a16 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830486.722632:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788830486.722635:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.121@tcp lock: ffff9e257d945200/0x575506951eea09e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x575506951eea09ec expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830486.722640:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e257d945200 already unused, calling callback (ffffffffc1aebc20) 10000000:00010000:1.0:1788830486.722642:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.121@tcp lock: ffff9e257d945200/0x575506951eea09e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x575506951eea09ec expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830486.722649:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.121@tcp lock: ffff9e257d945200/0x575506951eea09e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x575506951eea09ec expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788830486.722655:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.121@tcp lock: ffff9e257d945200/0x575506951eea09e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x575506951eea09ec expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788830486.722660:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788830486.722672:0:5820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.121@tcp lock: ffff9e257d945200/0x575506951eea09e5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x575506951eea09ec expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830486.722677:0:5820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788830486.722681:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.121@tcp lock: ffff9e257d945200/0x575506951eea09e5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x575506951eea09ec expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830486.722688:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.121@tcp lock: ffff9e257d945200/0x575506951eea09e5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x575506951eea09ec expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830486.722700:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788830486.722706:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788830486.722730:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788830486.722737:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788830486.722759:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25472fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1745cc3d-3952-4cd4-9020-9b8acb483105:3310:1875724595128448:0@lo:103: 00000100:00100000:1.0:1788830486.722797:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830486.722819:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257e926a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1745cc3d-3952-4cd4-9020-9b8acb483105:3310:1875724595128960:0@lo:103: 00000100:00100000:1.0:1788830486.722838:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830486.722857:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788830486.722862:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25472fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1745cc3d-3952-4cd4-9020-9b8acb483105:3310:1875724595128832:0@lo:103: 00000100:00100000:1.0:1788830486.722879:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830486.722906:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25472fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1745cc3d-3952-4cd4-9020-9b8acb483105:3307:1875724595128576:0@lo:103: 00000100:00100000:1.0:1788830486.722926:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830486.722936:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257e927480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1745cc3d-3952-4cd4-9020-9b8acb483105:3307:1875724595129088:0@lo:103: 00000100:00100000:1.0:1788830486.722965:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830486.722993:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788830486.722999:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25472fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1745cc3d-3952-4cd4-9020-9b8acb483105:3307:1875724595128704:0@lo:103: 00000100:00100000:1.0:1788830486.723018:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830486.723027:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257e924e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1745cc3d-3952-4cd4-9020-9b8acb483105:3307:1875724595129216:0@lo:103: 00000100:00100000:1.0:1788830486.723045:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830486.723069:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595128448 00000100:00100000:1.0:1788830486.723075:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595128448 00010000:00010000:1.0:1788830486.723099:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e257d80e600/0x575506951eea0a86 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x575506951eea0a7f expref: 19 pid: 5824 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788830486.723119:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595128960 00000100:00100000:1.0:1788830486.723121:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595128960 00010000:00010000:1.0:1788830486.723135:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e257d80e200/0x575506951eea0a39 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x575506951eea0a32 expref: 20 pid: 5824 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788830486.723157:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595128832 00000100:00100000:1.0:1788830486.723160:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595128832 00010000:00010000:1.0:1788830486.723173:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2540031e00/0x575506951eea0a47 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x575506951eea0a40 expref: 21 pid: 5824 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788830486.723182:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595128576 00000100:00100000:1.0:1788830486.723184:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595128576 00010000:00010000:1.0:1788830486.723193:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2445b7e400/0x575506951eea0a63 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x575506951eea0a5c expref: 22 pid: 5826 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788830486.723201:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595129088 00000100:00100000:1.0:1788830486.723203:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595129088 00010000:00010000:1.0:1788830486.723212:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2540031c00/0x575506951eea0a16 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x575506951eea0a0f expref: 23 pid: 5827 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788830486.723220:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595128704 00000100:00100000:1.0:1788830486.723222:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595128704 00010000:00010000:1.0:1788830486.723231:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2445b7e200/0x575506951eea0a55 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x575506951eea0a4e expref: 24 pid: 5824 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788830486.723239:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595129216 00000100:00100000:1.0:1788830486.723242:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595129216 00010000:00010000:1.0:1788830486.723250:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e25820fea00/0x575506951eea09ec lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x575506951eea09e5 expref: 25 pid: 5824 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788830486.723261:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788830486.723268:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257e927b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1745cc3d-3952-4cd4-9020-9b8acb483105+25:3310:x1875724595128448:12345-0@lo:103: 00010000:00010000:1.0:1788830486.723280:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788830486.723285:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e257d80e600/0x575506951eea0a86 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x575506951eea0a7f expref: 25 pid: 5824 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830486.723302:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e257d80e600/0x575506951eea0a86 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x575506951eea0a7f expref: 25 pid: 5824 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830486.723319:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788830486.723362:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257e927b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1745cc3d-3952-4cd4-9020-9b8acb483105+25:3310:x1875724595128448:12345-0@lo:103: Request processed in 94us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830486.723368:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788830486.723384:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788830486.723389:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257e925500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1745cc3d-3952-4cd4-9020-9b8acb483105+24:3310:x1875724595128960:12345-0@lo:103: 00010000:00010000:1.0:1788830486.723396:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788830486.723400:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e257d80e200/0x575506951eea0a39 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x575506951eea0a32 expref: 24 pid: 5824 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830486.723408:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e257d80e200/0x575506951eea0a39 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x575506951eea0a32 expref: 24 pid: 5824 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830486.723416:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788830486.723434:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257e925500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1745cc3d-3952-4cd4-9020-9b8acb483105+24:3310:x1875724595128960:12345-0@lo:103: Request processed in 45us (595us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830486.723439:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788830486.723450:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788830486.723455:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257e925f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1745cc3d-3952-4cd4-9020-9b8acb483105+23:3310:x1875724595128832:12345-0@lo:103: 00010000:00010000:1.0:1788830486.723461:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788830486.723465:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2540031e00/0x575506951eea0a47 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x575506951eea0a40 expref: 23 pid: 5824 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830486.723472:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2540031e00/0x575506951eea0a47 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x575506951eea0a40 expref: 23 pid: 5824 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830486.723487:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788830486.723508:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257e925f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1745cc3d-3952-4cd4-9020-9b8acb483105+23:3310:x1875724595128832:12345-0@lo:103: Request processed in 53us (627us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830486.723514:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788830486.723526:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788830486.723531:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257f804e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1745cc3d-3952-4cd4-9020-9b8acb483105+22:3307:x1875724595128576:12345-0@lo:103: 00010000:00010000:1.0:1788830486.723538:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788830486.723542:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2445b7e400/0x575506951eea0a63 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x575506951eea0a5c expref: 22 pid: 5826 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830486.723549:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2445b7e400/0x575506951eea0a63 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x575506951eea0a5c expref: 22 pid: 5826 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830486.723557:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788830486.723579:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257f804e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1745cc3d-3952-4cd4-9020-9b8acb483105+22:3307:x1875724595128576:12345-0@lo:103: Request processed in 48us (651us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830486.723585:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788830486.723596:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788830486.723601:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25654e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1745cc3d-3952-4cd4-9020-9b8acb483105+21:3307:x1875724595129088:12345-0@lo:103: 00010000:00010000:1.0:1788830486.723608:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788830486.723613:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2540031c00/0x575506951eea0a16 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x575506951eea0a0f expref: 21 pid: 5827 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830486.723621:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2540031c00/0x575506951eea0a16 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x575506951eea0a0f expref: 21 pid: 5827 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830486.723629:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788830486.723657:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25654e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1745cc3d-3952-4cd4-9020-9b8acb483105+21:3307:x1875724595129088:12345-0@lo:103: Request processed in 56us (691us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830486.723666:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788830486.723678:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788830486.723684:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25654e9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1745cc3d-3952-4cd4-9020-9b8acb483105+20:3307:x1875724595128704:12345-0@lo:103: 00010000:00010000:1.0:1788830486.723691:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788830486.723694:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2445b7e200/0x575506951eea0a55 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x575506951eea0a4e expref: 20 pid: 5824 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830486.723702:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2445b7e200/0x575506951eea0a55 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x575506951eea0a4e expref: 20 pid: 5824 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830486.723734:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788830486.723756:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25654e9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1745cc3d-3952-4cd4-9020-9b8acb483105+20:3307:x1875724595128704:12345-0@lo:103: Request processed in 72us (736us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830486.723762:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788830486.723773:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788830486.723779:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2547434050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1745cc3d-3952-4cd4-9020-9b8acb483105+19:3307:x1875724595129216:12345-0@lo:103: 00010000:00010000:1.0:1788830486.723786:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788830486.723789:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e25820fea00/0x575506951eea09ec lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x575506951eea09e5 expref: 19 pid: 5824 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830486.723796:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e25820fea00/0x575506951eea09ec lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x575506951eea09e5 expref: 19 pid: 5824 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830486.723805:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788830486.723823:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2547434050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1745cc3d-3952-4cd4-9020-9b8acb483105+19:3307:x1875724595129216:12345-0@lo:103: Request processed in 45us (778us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830486.723829:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788830486.723913:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25472fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1745cc3d-3952-4cd4-9020-9b8acb483105:3310:1875724595128832:0@lo:103: 00000100:00100000:1.0:1788830486.723922:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25472fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1745cc3d-3952-4cd4-9020-9b8acb483105:3310:1875724595128448:0@lo:103: 00000100:00100000:1.0:1788830486.723928:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257e926a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1745cc3d-3952-4cd4-9020-9b8acb483105:3310:1875724595128960:0@lo:103: 00000100:00100000:1.0:1788830486.723958:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25472fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1745cc3d-3952-4cd4-9020-9b8acb483105:3307:1875724595128704:0@lo:103: 00000100:00100000:1.0:1788830486.723965:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257e924e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1745cc3d-3952-4cd4-9020-9b8acb483105:3307:1875724595129216:0@lo:103: 00000100:00100000:1.0:1788830486.723985:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25472fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1745cc3d-3952-4cd4-9020-9b8acb483105:3307:1875724595128576:0@lo:103: 00000100:00100000:1.0:1788830486.723993:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257e927480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1745cc3d-3952-4cd4-9020-9b8acb483105:3307:1875724595129088:0@lo:103: 00010000:00010000:3.0:1788830486.724508:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e257d80e600/0x575506951eea0a86 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x575506951eea0a7f expref: 18 pid: 5824 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788830486.724525:0:8442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e255005fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8442:1875724595127552:0@lo:104: 00010000:00010000:3.0:1788830486.724536:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2445b7e400/0x575506951eea0a63 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x575506951eea0a5c expref: 17 pid: 5826 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788830486.724544:0:8442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e255005dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8442:1875724595127680:0@lo:104: 00010000:00010000:3.0:1788830486.724553:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2445b7e200/0x575506951eea0a55 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x575506951eea0a4e expref: 16 pid: 5824 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788830486.724561:0:8442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e255005d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8442:1875724595127808:0@lo:104: 00010000:00010000:3.0:1788830486.724569:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2540031e00/0x575506951eea0a47 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x575506951eea0a40 expref: 15 pid: 5824 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788830486.724579:0:8442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e255005e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8442:1875724595127936:0@lo:104: 00010000:00010000:3.0:1788830486.724587:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e257d80e200/0x575506951eea0a39 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x575506951eea0a32 expref: 14 pid: 5824 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788830486.724604:0:8442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e255005ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8442:1875724595128064:0@lo:104: 00010000:00010000:3.0:1788830486.724616:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2540031c00/0x575506951eea0a16 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x575506951eea0a0f expref: 13 pid: 5827 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788830486.724624:0:8442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e255005df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8442:1875724595128192:0@lo:104: 00010000:00010000:3.0:1788830486.724633:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e25820fea00/0x575506951eea09ec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x575506951eea09e5 expref: 12 pid: 5824 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788830486.724641:0:8442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e255005f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8442:1875724595128320:0@lo:104: 00000100:00100000:3.0:1788830486.728116:0:8442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2566011500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8442:1875724595127296:192.168.201.21@tcp:104: 00000100:00100000:3.0:1788830486.728132:0:8442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2566012680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8442:1875724595127424:192.168.201.21@tcp:104: 00010000:00010000:3.0:1788830486.728179:0:8442:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2565728a00/0x575506951eea0aef lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788830486.730562:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830486.730650:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830486.731437:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578328704 00000100:00100000:1.0:1788830486.731450:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578328704 00010000:00010000:1.0:1788830486.731498:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e257d945800/0x575506951eea0ab0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661b85 expref: 10 pid: 5827 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788830486.731548:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578328576 00000100:00100000:3.0:1788830486.731552:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578328576 00010000:00010000:3.0:1788830486.731570:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e257d945a00/0x575506951eea0ab7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661b8c expref: 11 pid: 5826 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788830486.731652:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 19 00000100:00100000:3.0:1788830486.731663:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255005ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+11:2355:x1875724578328704:12345-192.168.201.21@tcp:103: 00010000:00010000:3.0:1788830486.731680:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788830486.731686:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e257d945800/0x575506951eea0ab0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661b85 expref: 11 pid: 5827 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830486.731698:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e257d945800/0x575506951eea0ab0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661b85 expref: 11 pid: 5827 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830486.731759:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e257d945800/0x575506951eea0ab0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661b85 expref: 11 pid: 5827 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830486.731775:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788830486.731855:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255005ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+10:2355:x1875724578328704:12345-192.168.201.21@tcp:103: Request processed in 185us (1295us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830486.731863:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 19 00000100:00100000:3.0:1788830486.731881:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 20 00000100:00100000:3.0:1788830486.731888:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255005ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+9:2354:x1875724578328576:12345-192.168.201.21@tcp:103: 00010000:00010000:3.0:1788830486.731895:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788830486.731900:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e257d945a00/0x575506951eea0ab7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661b8c expref: 9 pid: 5826 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830486.731909:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e257d945a00/0x575506951eea0ab7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661b8c expref: 9 pid: 5826 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830486.731919:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e257d945a00/0x575506951eea0ab7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661b8c expref: 9 pid: 5826 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830486.731930:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2565728a00/0x575506951eea0aef lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830486.731938:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2565728a00/0x575506951eea0aef lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830486.731953:0:5817:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2565728a00/0x575506951eea0aef lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830486.731982:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2565728a00/0x575506951eea0aef lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830486.731990:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2565728a00/0x575506951eea0aef lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830486.731997:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2565728a00/0x575506951eea0aef lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830486.732003:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2565728a00 already unused, calling callback (ffffffffc14cb350) 00010000:00010000:3.0:1788830486.732008:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2565728a00/0x575506951eea0aef lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830486.732016:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2565728a00/0x575506951eea0aef lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830486.732033:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2565728a00/0x575506951eea0aef lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830486.732045:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788830486.732068:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255005ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+8:2354:x1875724578328576:12345-192.168.201.21@tcp:103: Request processed in 180us (1418us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830486.732075:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 20 00010000:00010000:3.0:1788830486.732104:0:8442:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2565728a00/0x575506951eea0aef lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830486.732112:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2565728a00/0x575506951eea0aef lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830486.732119:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2565728a00/0x575506951eea0aef lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830487.580498:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788830488.455518:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830488.457972:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578328832 00000100:00100000:2.0:1788830488.457990:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578328832 00000100:00100000:2.0:1788830488.458076:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 131 00000100:00100000:2.0:1788830488.458088:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255d99b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+8:2354:x1875724578328832:12345-192.168.201.21@tcp:400: 00000100:00100000:2.0:1788830488.458182:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255d99b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+8:2354:x1875724578328832:12345-192.168.201.21@tcp:400: Request processed in 97us (2675us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830488.458207:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 131 00000100:00100000:2.0:1788830488.472073:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830488.472116:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830488.472161:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830488.472247:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578328960 00000100:00100000:3.0:1788830488.472260:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578328960 00000100:00100000:3.0:1788830488.472336:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 21 00000100:00100000:3.0:1788830488.472347:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255005c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+6:2354:x1875724578328960:12345-192.168.201.21@tcp:400: 00000100:00100000:3.0:1788830488.472423:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255005c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+6:2354:x1875724578328960:12345-192.168.201.21@tcp:400: Request processed in 77us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830488.472430:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 21 00000100:00100000:1.0:1788830488.472510:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578329216 00000100:00100000:1.0:1788830488.472515:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578329216 00000100:00100000:1.0:1788830488.472552:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578329088 00000100:00100000:1.0:1788830488.472555:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578329088 00000100:00100000:1.0:1788830488.472573:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 10 00000100:00100000:1.0:1788830488.472580:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255005ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+5:2355:x1875724578329216:12345-192.168.201.21@tcp:400: 00000100:00100000:1.0:1788830488.472609:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255005ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+5:2355:x1875724578329216:12345-192.168.201.21@tcp:400: Request processed in 30us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830488.472615:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 10 00000100:00100000:1.0:1788830488.472629:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 11 00000100:00100000:1.0:1788830488.472635:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255005f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+5:2354:x1875724578329088:12345-192.168.201.21@tcp:400: 00000100:00100000:1.0:1788830488.472679:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255005f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+5:2354:x1875724578329088:12345-192.168.201.21@tcp:400: Request processed in 44us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830488.472685:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 11 00000100:00080000:2.0:1788830488.472846:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788830488.472851:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788830488.472853:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 10000000:01000000:1.0:1788830488.476023:0:5829:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788830488.476032:0:5829:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9e2444ab0800 from 39 10000000:01000000:1.0:1788830488.476038:0:5829:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788830488.476087:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.121@tcp lock: ffff9e25820ffc00/0x575506951eea0af6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830488.476100:0:5829:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.121@tcp lock: ffff9e25820ffc00/0x575506951eea0af6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830488.476112:0:5829:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.121@tcp lock: ffff9e25820ffc00/0x575506951eea0af6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788830488.476137:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25654e9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1745cc3d-3952-4cd4-9020-9b8acb483105:5829:1875724595129344:0@lo:101: 00000100:00100000:1.0:1788830488.476197:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830488.476252:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2553221780 going to sleep for 11 seconds 00000100:00100000:2.0:1788830488.476326:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595129344 00000100:00100000:2.0:1788830488.476334:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595129344 00000100:00100000:2.0:1788830488.476383:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1788830488.476391:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255d99a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1745cc3d-3952-4cd4-9020-9b8acb483105+12:5829:x1875724595129344:12345-0@lo:101: 00010000:00010000:2.0:1788830488.476403:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788830488.476416:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2565728600/0x575506951eea0afd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x575506951eea0af6 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830488.476438:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2565728600/0x575506951eea0afd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x575506951eea0af6 expref: 13 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830488.476448:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2565728600/0x575506951eea0afd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x575506951eea0af6 expref: 13 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830488.476456:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2565728600, rc 0) 00000100:00100000:2.0:1788830488.476499:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255d99a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1745cc3d-3952-4cd4-9020-9b8acb483105+13:5829:x1875724595129344:12345-0@lo:101: Request processed in 108us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830488.476506:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788830488.477745:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25654e9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1745cc3d-3952-4cd4-9020-9b8acb483105:5829:1875724595129344:0@lo:101: 00010000:00010000:1.0:1788830488.477776:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.121@tcp lock: ffff9e25820ffc00/0x575506951eea0af6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea0afd expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830488.477790:0:5829:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.121@tcp lock: ffff9e25820ffc00/0x575506951eea0af6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x575506951eea0afd expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788830488.477877:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25654e9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1745cc3d-3952-4cd4-9020-9b8acb483105:5829:1875724595129472:0@lo:501: 00000100:00100000:1.0:1788830488.477926:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830488.477974:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2553221780 going to sleep for 11 seconds 00000100:00100000:2.0:1788830488.478190:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595129472 00000100:00100000:2.0:1788830488.478197:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595129472 00000100:00100000:2.0:1788830488.478239:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1788830488.478247:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255d99bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1745cc3d-3952-4cd4-9020-9b8acb483105+13:5829:x1875724595129472:12345-0@lo:501: 00000100:00100000:2.0:1788830488.478527:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255d99bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1745cc3d-3952-4cd4-9020-9b8acb483105+13:5829:x1875724595129472:12345-0@lo:501: Request processed in 280us (600us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830488.478534:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788830488.478665:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25654e9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1745cc3d-3952-4cd4-9020-9b8acb483105:5829:1875724595129472:0@lo:501: 00000100:00100000:0.0:1788830488.478698:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257fa65c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1745cc3d-3952-4cd4-9020-9b8acb483105:5829:1875724595129600:0@lo:503: 00000100:00100000:0.0:1788830488.478768:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830488.478802:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2545cc9600 going to sleep for 11 seconds 00000100:00100000:3.0:1788830488.478881:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595129600 00000100:00100000:3.0:1788830488.478886:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595129600 00000100:00100000:3.0:1788830488.478910:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788830488.478917:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255d999450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+13:5829:x1875724595129600:12345-0@lo:503: 00000100:00100000:3.0:1788830488.479088:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255d999450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+13:5829:x1875724595129600:12345-0@lo:503: Request processed in 170us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830488.479095:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1788830488.479340:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257fa65c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1745cc3d-3952-4cd4-9020-9b8acb483105:5829:1875724595129600:0@lo:503: 00000100:00100000:1.0:1788830488.485701:0:8459:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25654e9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1745cc3d-3952-4cd4-9020-9b8acb483105:8459:1875724595129728:0@lo:502: 00000100:00100000:1.0:1788830488.486023:0:8459:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830488.486075:0:8459:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2553221480 going to sleep for 11 seconds 00000100:00100000:3.0:1788830488.486154:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595129728 00000100:00100000:3.0:1788830488.486162:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595129728 00000100:00100000:3.0:1788830488.486215:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788830488.486225:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255d999050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+13:8459:x1875724595129728:12345-0@lo:502: 00000100:00100000:3.0:1788830488.486491:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255d999050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+13:8459:x1875724595129728:12345-0@lo:502: Request processed in 266us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830488.486500:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788830488.486873:0:8459:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25654e9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1745cc3d-3952-4cd4-9020-9b8acb483105:8459:1875724595129728:0@lo:502: 00000100:00100000:1.0:1788830488.486928:0:8459:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25654e9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1745cc3d-3952-4cd4-9020-9b8acb483105:8459:1875724595129856:0@lo:502: 00000100:00100000:1.0:1788830488.486975:0:8459:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830488.487007:0:8459:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2553221480 going to sleep for 11 seconds 00000100:00100000:2.0:1788830488.487128:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595129856 00000100:00100000:2.0:1788830488.487135:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595129856 00000100:00100000:2.0:1788830488.487170:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788830488.487179:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255d99b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1745cc3d-3952-4cd4-9020-9b8acb483105+13:8459:x1875724595129856:12345-0@lo:502: 00000100:00100000:2.0:1788830488.487346:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255d99b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1745cc3d-3952-4cd4-9020-9b8acb483105+13:8459:x1875724595129856:12345-0@lo:502: Request processed in 168us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830488.487353:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1788830488.491356:0:8459:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25654e9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1745cc3d-3952-4cd4-9020-9b8acb483105:8459:1875724595129856:0@lo:502: 00000040:00080000:1.0:1788830488.491424:0:8459:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1788830488.493426:0:5829:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1788830488.493460:0:5829:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.121@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788830488.493474:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: ffff9e25820ffc00/0x575506951eea0af6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea0afd expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830488.493487:0:5829:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.121@tcp lock: ffff9e25820ffc00/0x575506951eea0af6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea0afd expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788830488.493499:0:5829:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1788830488.493502:0:5829:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:0.0:1788830488.493505:0:5829:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1788830488.493561:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.121@tcp lock: ffff9e2445b7e000/0x575506951eea0b04 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830488.493569:0:5829:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.121@tcp lock: ffff9e2445b7e000/0x575506951eea0b04 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830488.493579:0:5829:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.121@tcp lock: ffff9e2445b7e000/0x575506951eea0b04 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788830488.493623:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257fa65c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1745cc3d-3952-4cd4-9020-9b8acb483105:5829:1875724595129984:0@lo:101: 00000100:00100000:0.0:1788830488.493698:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830488.493769:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2545cc9600 going to sleep for 11 seconds 00000100:00100000:2.0:1788830488.493842:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595129984 00000100:00100000:2.0:1788830488.493851:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595129984 00000100:00100000:2.0:1788830488.493903:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1788830488.493913:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255d998850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1745cc3d-3952-4cd4-9020-9b8acb483105+13:5829:x1875724595129984:12345-0@lo:101: 00010000:00010000:2.0:1788830488.493927:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788830488.493949:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2565729c00/0x575506951eea0b0b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x575506951eea0b04 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830488.493974:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2565729c00/0x575506951eea0b0b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x575506951eea0b04 expref: 14 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830488.493986:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2565729c00/0x575506951eea0b0b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x575506951eea0b04 expref: 14 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830488.493994:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2565729c00, rc 0) 00000100:00100000:2.0:1788830488.494045:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255d998850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1745cc3d-3952-4cd4-9020-9b8acb483105+14:5829:x1875724595129984:12345-0@lo:101: Request processed in 133us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830488.494051:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1788830488.494204:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257fa65c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1745cc3d-3952-4cd4-9020-9b8acb483105:5829:1875724595129984:0@lo:101: 00010000:00010000:0.0:1788830488.494223:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.121@tcp lock: ffff9e2445b7e000/0x575506951eea0b04 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea0b0b expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830488.494231:0:5829:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.121@tcp lock: ffff9e2445b7e000/0x575506951eea0b04 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x575506951eea0b0b expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788830488.494282:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257fa65c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1745cc3d-3952-4cd4-9020-9b8acb483105:5829:1875724595130112:0@lo:501: 00000100:00100000:0.0:1788830488.494308:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830488.494338:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2545cc9600 going to sleep for 11 seconds 00000100:00100000:3.0:1788830488.494432:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595130112 00000100:00100000:3.0:1788830488.494437:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595130112 00000100:00100000:3.0:1788830488.494474:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788830488.494481:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255d998050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+14:5829:x1875724595130112:12345-0@lo:501: 00000100:00100000:3.0:1788830488.494755:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255d998050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+14:5829:x1875724595130112:12345-0@lo:501: Request processed in 273us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830488.494762:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1788830488.494927:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257fa65c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1745cc3d-3952-4cd4-9020-9b8acb483105:5829:1875724595130112:0@lo:501: 00000100:00100000:0.0:1788830488.494993:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257fa65c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1745cc3d-3952-4cd4-9020-9b8acb483105:5829:1875724595130240:0@lo:503: 00000100:00100000:0.0:1788830488.495031:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830488.495061:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2545cc9600 going to sleep for 11 seconds 00000100:00100000:1.0:1788830488.495298:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595130240 00000100:00100000:1.0:1788830488.495303:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595130240 00000100:00100000:1.0:1788830488.495336:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788830488.495344:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255d999c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1745cc3d-3952-4cd4-9020-9b8acb483105+14:5829:x1875724595130240:12345-0@lo:503: 00000100:00100000:1.0:1788830488.495485:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255d999c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1745cc3d-3952-4cd4-9020-9b8acb483105+14:5829:x1875724595130240:12345-0@lo:503: Request processed in 141us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830488.495491:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788830488.495569:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257fa65c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1745cc3d-3952-4cd4-9020-9b8acb483105:5829:1875724595130240:0@lo:503: 00000100:00100000:0.0:1788830488.496174:0:8460:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257fa65c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1745cc3d-3952-4cd4-9020-9b8acb483105:8460:1875724595130368:0@lo:502: 00000100:00100000:0.0:1788830488.496213:0:8460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830488.496240:0:8460:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2545cc9480 going to sleep for 11 seconds 00000100:00100000:2.0:1788830488.496277:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595130368 00000100:00100000:2.0:1788830488.496282:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595130368 00000100:00100000:2.0:1788830488.496311:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788830488.496318:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255d99a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1745cc3d-3952-4cd4-9020-9b8acb483105+14:8460:x1875724595130368:12345-0@lo:502: 00000100:00100000:2.0:1788830488.496458:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255d99a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1745cc3d-3952-4cd4-9020-9b8acb483105+14:8460:x1875724595130368:12345-0@lo:502: Request processed in 139us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830488.496464:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788830488.496532:0:8460:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257fa65c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1745cc3d-3952-4cd4-9020-9b8acb483105:8460:1875724595130368:0@lo:502: 00000020:01000000:0.0:1788830488.496565:0:8460:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788830488.496573:0:8460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788830488.496579:0:8460:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788830488.496585:0:8460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788830488.496603:0:8460:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257fa65c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1745cc3d-3952-4cd4-9020-9b8acb483105:8460:1875724595130496:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788830488.496630:0:8460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830488.496649:0:8460:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2545cc9480 going to sleep for 11 seconds 00000100:00100000:3.0:1788830488.496696:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595130496 00000100:00100000:3.0:1788830488.496700:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595130496 00000100:00100000:3.0:1788830488.496750:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788830488.496756:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255d998450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+14:8460:x1875724595130496:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788830488.496881:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255d998450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+14:8460:x1875724595130496:12345-0@lo:502:llog_process_th.0 Request processed in 125us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830488.496887:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788830488.497017:0:8460:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257fa65c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1745cc3d-3952-4cd4-9020-9b8acb483105:8460:1875724595130496:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788830488.497033:0:8460:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788830488.497036:0:8460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788830488.497038:0:8460:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788830488.497042:0:8460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:3.0:1788830488.497404:0:5829:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:3.0:1788830488.497420:0:5829:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.121@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1788830488.497430:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: ffff9e2445b7e000/0x575506951eea0b04 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea0b0b expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830488.497441:0:5829:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.121@tcp lock: ffff9e2445b7e000/0x575506951eea0b04 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea0b0b expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788830488.497450:0:5829:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788830488.497452:0:5829:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9e2565dcd800 from 39 10000000:01000000:3.0:1788830488.497455:0:5829:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788830488.497478:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.121@tcp lock: ffff9e257d945a00/0x575506951eea0b12 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830488.497485:0:5829:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.121@tcp lock: ffff9e257d945a00/0x575506951eea0b12 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830488.497495:0:5829:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.121@tcp lock: ffff9e257d945a00/0x575506951eea0b12 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788830488.497518:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257f727100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1745cc3d-3952-4cd4-9020-9b8acb483105:5829:1875724595130624:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788830488.497544:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830488.497580:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2565619240 going to sleep for 11 seconds 00000100:00100000:2.0:1788830488.497622:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595130624 00000100:00100000:2.0:1788830488.497627:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595130624 00000100:00100000:2.0:1788830488.497655:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788830488.497661:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255d99b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+14:5829:x1875724595130624:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788830488.497670:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788830488.497681:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2565728200/0x575506951eea0b19 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x575506951eea0b12 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830488.497699:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2565728200/0x575506951eea0b19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x575506951eea0b12 expref: 15 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830488.497729:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2565728200/0x575506951eea0b19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x575506951eea0b12 expref: 15 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830488.497739:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2565728200, rc 0) 00000100:00100000:2.0:1788830488.497772:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255d99b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+15:5829:x1875724595130624:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 111us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830488.497778:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1788830488.497863:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257f727100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1745cc3d-3952-4cd4-9020-9b8acb483105:5829:1875724595130624:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788830488.497875:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.121@tcp lock: ffff9e257d945a00/0x575506951eea0b12 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea0b19 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830488.497884:0:5829:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.121@tcp lock: ffff9e257d945a00/0x575506951eea0b12 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x575506951eea0b19 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788830488.497921:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257fa65c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1745cc3d-3952-4cd4-9020-9b8acb483105:5829:1875724595130752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788830488.497954:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830488.497969:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2545cc9480 going to sleep for 11 seconds 00000100:00100000:0.0:1788830488.497982:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595130752 00000100:00100000:0.0:1788830488.497985:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595130752 00000100:00100000:0.0:1788830488.498001:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788830488.498007:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255d99ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+15:5829:x1875724595130752:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788830488.498229:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255d99ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+15:5829:x1875724595130752:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 221us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830488.498236:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788830488.498275:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257fa65c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1745cc3d-3952-4cd4-9020-9b8acb483105:5829:1875724595130752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788830488.498298:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257fa65c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1745cc3d-3952-4cd4-9020-9b8acb483105:5829:1875724595130880:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788830488.498329:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830488.498342:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2545cc9480 going to sleep for 11 seconds 00000100:00100000:0.0:1788830488.498352:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595130880 00000100:00100000:0.0:1788830488.498355:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595130880 00000100:00100000:0.0:1788830488.498372:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788830488.498377:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255d998c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+15:5829:x1875724595130880:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788830488.498505:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255d998c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+15:5829:x1875724595130880:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 127us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830488.498511:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788830488.498549:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257fa65c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1745cc3d-3952-4cd4-9020-9b8acb483105:5829:1875724595130880:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788830488.498700:0:8461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257fa65c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1745cc3d-3952-4cd4-9020-9b8acb483105:8461:1875724595131008:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788830488.498755:0:8461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830488.498773:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595131008 00000100:00100000:0.0:1788830488.498777:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595131008 00000100:00100000:0.0:1788830488.498795:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788830488.498800:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255d99a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+15:8461:x1875724595131008:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788830488.498952:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255d99a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+15:8461:x1875724595131008:12345-0@lo:502:llog_process_th.0 Request processed in 140us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830488.498960:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788830488.498988:0:8461:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2545cc90c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788830488.498999:0:8461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257fa65c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1745cc3d-3952-4cd4-9020-9b8acb483105:8461:1875724595131008:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788830488.499034:0:8461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257fa65c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1745cc3d-3952-4cd4-9020-9b8acb483105:8461:1875724595131136:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788830488.499070:0:8461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830488.499087:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595131136 00000100:00100000:0.0:1788830488.499091:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595131136 00000100:00100000:0.0:1788830488.499107:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788830488.499113:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255d999850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+15:8461:x1875724595131136:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788830488.499226:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255d999850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+15:8461:x1875724595131136:12345-0@lo:502:llog_process_th.0 Request processed in 112us (155us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830488.499232:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788830488.499258:0:8461:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2545cc90c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788830488.499269:0:8461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257fa65c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1745cc3d-3952-4cd4-9020-9b8acb483105:8461:1875724595131136:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1788830488.499287:0:8461:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1788830488.499328:0:5829:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1788830488.499341:0:5829:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.121@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788830488.499348:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: ffff9e257d945a00/0x575506951eea0b12 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea0b19 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830488.499356:0:5829:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.121@tcp lock: ffff9e257d945a00/0x575506951eea0b12 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea0b19 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788830488.499364:0:5829:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1788830488.499366:0:5829:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:0.0:1788830488.499369:0:5829:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788830488.499388:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.121@tcp lock: ffff9e2445b7ea00/0x575506951eea0b20 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830488.499394:0:5829:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.121@tcp lock: ffff9e2445b7ea00/0x575506951eea0b20 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830488.499414:0:5829:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.121@tcp lock: ffff9e2445b7ea00/0x575506951eea0b20 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788830488.499427:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257fa65c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1745cc3d-3952-4cd4-9020-9b8acb483105:5829:1875724595131264:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788830488.499453:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830488.499467:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2543113840 going to sleep for 11 seconds 00000100:00100000:0.0:1788830488.499480:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595131264 00000100:00100000:0.0:1788830488.499483:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595131264 00000100:00100000:0.0:1788830488.499500:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788830488.499505:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2574712850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+15:5829:x1875724595131264:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788830488.499511:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788830488.499521:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2445b7e600/0x575506951eea0b27 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x575506951eea0b20 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830488.499537:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2445b7e600/0x575506951eea0b27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x575506951eea0b20 expref: 16 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830488.499546:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2445b7e600/0x575506951eea0b27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x575506951eea0b20 expref: 16 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830488.499552:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2445b7e600, rc 0) 00000100:00100000:0.0:1788830488.499579:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2574712850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+16:5829:x1875724595131264:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 73us (125us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830488.499583:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788830488.499609:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257fa65c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1745cc3d-3952-4cd4-9020-9b8acb483105:5829:1875724595131264:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788830488.499620:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.121@tcp lock: ffff9e2445b7ea00/0x575506951eea0b20 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea0b27 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830488.499635:0:5829:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.121@tcp lock: ffff9e2445b7ea00/0x575506951eea0b20 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x575506951eea0b27 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788830488.499671:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257fa65c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1745cc3d-3952-4cd4-9020-9b8acb483105:5829:1875724595131392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788830488.499695:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830488.499728:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2545cc99c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788830488.499740:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595131392 00000100:00100000:0.0:1788830488.499743:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595131392 00000100:00100000:0.0:1788830488.499760:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788830488.499764:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2574713c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+16:5829:x1875724595131392:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788830488.499954:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2574713c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+16:5829:x1875724595131392:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 175us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830488.499960:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788830488.499989:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257fa65c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1745cc3d-3952-4cd4-9020-9b8acb483105:5829:1875724595131392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788830488.500011:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257fa65c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1745cc3d-3952-4cd4-9020-9b8acb483105:5829:1875724595131520:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788830488.500042:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830488.500055:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2545cc99c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788830488.500065:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595131520 00000100:00100000:0.0:1788830488.500068:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595131520 00000100:00100000:0.0:1788830488.500084:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788830488.500088:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2574711050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+16:5829:x1875724595131520:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788830488.500210:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2574711050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+16:5829:x1875724595131520:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 120us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830488.500216:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788830488.500255:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257fa65c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1745cc3d-3952-4cd4-9020-9b8acb483105:5829:1875724595131520:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788830488.500441:0:8462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257fa65c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1745cc3d-3952-4cd4-9020-9b8acb483105:8462:1875724595131648:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788830488.500474:0:8462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830488.500493:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595131648 00000100:00100000:0.0:1788830488.500496:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595131648 00000100:00100000:0.0:1788830488.500513:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788830488.500518:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2574713850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+16:8462:x1875724595131648:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788830488.500632:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2574713850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+16:8462:x1875724595131648:12345-0@lo:502:llog_process_th.0 Request processed in 113us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830488.500638:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788830488.500665:0:8462:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2547287780 going to sleep for 11 seconds 00000100:00100000:0.0:1788830488.500676:0:8462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257fa65c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1745cc3d-3952-4cd4-9020-9b8acb483105:8462:1875724595131648:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788830488.500695:0:8462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788830488.500703:0:8462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788830488.500705:0:8462:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788830488.500731:0:8462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788830488.500750:0:8462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257fa65c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1745cc3d-3952-4cd4-9020-9b8acb483105:8462:1875724595131776:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788830488.500781:0:8462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830488.500799:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595131776 00000100:00100000:0.0:1788830488.500802:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595131776 00000100:00100000:0.0:1788830488.500818:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788830488.500823:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2574710850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+16:8462:x1875724595131776:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788830488.500925:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2574710850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+16:8462:x1875724595131776:12345-0@lo:502:llog_process_th.0 Request processed in 102us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830488.500932:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788830488.501485:0:8462:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2550b87d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788830488.501503:0:8462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257fa65c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1745cc3d-3952-4cd4-9020-9b8acb483105:8462:1875724595131776:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788830488.501528:0:8462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788830488.501534:0:8462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788830488.501536:0:8462:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788830488.501540:0:8462:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:2.0:1788830488.501740:0:5829:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:2.0:1788830488.501759:0:5829:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.121@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788830488.501769:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: ffff9e2445b7ea00/0x575506951eea0b20 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea0b27 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830488.501786:0:5829:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.121@tcp lock: ffff9e2445b7ea00/0x575506951eea0b20 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea0b27 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788830488.501797:0:5829:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788830488.501799:0:5829:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9e255d9b0800 from 39 10000000:01000000:2.0:1788830488.501802:0:5829:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788830488.501839:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.121@tcp lock: ffff9e2565729e00/0x575506951eea0b2e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830488.501847:0:5829:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.121@tcp lock: ffff9e2565729e00/0x575506951eea0b2e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830488.501855:0:5829:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.121@tcp lock: ffff9e2565729e00/0x575506951eea0b2e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788830488.501871:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e255005d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1745cc3d-3952-4cd4-9020-9b8acb483105:5829:1875724595131904:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788830488.501910:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788830488.501947:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e257f723000 going to sleep for 11 seconds 00000100:00100000:3.0:1788830488.502064:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595131904 00000100:00100000:3.0:1788830488.502071:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595131904 00000100:00100000:3.0:1788830488.502106:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788830488.502114:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2574711c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1745cc3d-3952-4cd4-9020-9b8acb483105+16:5829:x1875724595131904:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788830488.502122:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788830488.502133:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e257d945800/0x575506951eea0b35 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x575506951eea0b2e expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830488.502153:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e257d945800/0x575506951eea0b35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x575506951eea0b2e expref: 17 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830488.502162:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e257d945800/0x575506951eea0b35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x575506951eea0b2e expref: 17 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830488.502170:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e257d945800, rc 0) 00000100:00100000:3.0:1788830488.502208:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2574711c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1745cc3d-3952-4cd4-9020-9b8acb483105+17:5829:x1875724595131904:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 94us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830488.502214:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788830488.502372:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e255005d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1745cc3d-3952-4cd4-9020-9b8acb483105:5829:1875724595131904:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788830488.502384:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.121@tcp lock: ffff9e2565729e00/0x575506951eea0b2e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea0b35 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830488.502392:0:5829:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.121@tcp lock: ffff9e2565729e00/0x575506951eea0b2e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x575506951eea0b35 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788830488.502439:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e255005d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1745cc3d-3952-4cd4-9020-9b8acb483105:5829:1875724595132032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788830488.502464:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788830488.502494:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e257f723000 going to sleep for 11 seconds 00000100:00100000:3.0:1788830488.502547:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595132032 00000100:00100000:3.0:1788830488.502563:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595132032 00000100:00100000:3.0:1788830488.502591:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788830488.502598:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2574712450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1745cc3d-3952-4cd4-9020-9b8acb483105+17:5829:x1875724595132032:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788830488.502866:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2574712450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1745cc3d-3952-4cd4-9020-9b8acb483105+17:5829:x1875724595132032:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 267us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830488.502878:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788830488.503134:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e255005d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1745cc3d-3952-4cd4-9020-9b8acb483105:5829:1875724595132032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788830488.503167:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e255005d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1745cc3d-3952-4cd4-9020-9b8acb483105:5829:1875724595132160:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788830488.503204:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788830488.503234:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e257f723000 going to sleep for 11 seconds 00000100:00100000:1.0:1788830488.503306:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595132160 00000100:00100000:1.0:1788830488.503312:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595132160 00000100:00100000:1.0:1788830488.503336:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788830488.503343:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2574710450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1745cc3d-3952-4cd4-9020-9b8acb483105+17:5829:x1875724595132160:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788830488.503494:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2574710450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1745cc3d-3952-4cd4-9020-9b8acb483105+17:5829:x1875724595132160:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 151us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830488.503501:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788830488.503590:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e255005d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1745cc3d-3952-4cd4-9020-9b8acb483105:5829:1875724595132160:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788830488.504074:0:8463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e255005d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1745cc3d-3952-4cd4-9020-9b8acb483105:8463:1875724595132288:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788830488.504112:0:8463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788830488.504139:0:8463:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e257f723c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788830488.504177:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595132288 00000100:00100000:1.0:1788830488.504182:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595132288 00000100:00100000:1.0:1788830488.504203:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788830488.504210:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2574713450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1745cc3d-3952-4cd4-9020-9b8acb483105+17:8463:x1875724595132288:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788830488.504386:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2574713450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1745cc3d-3952-4cd4-9020-9b8acb483105+17:8463:x1875724595132288:12345-0@lo:502:llog_process_th.0 Request processed in 175us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830488.504392:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788830488.505764:0:8463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e255005d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1745cc3d-3952-4cd4-9020-9b8acb483105:8463:1875724595132288:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788830488.505915:0:8463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e255005d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1745cc3d-3952-4cd4-9020-9b8acb483105:8463:1875724595132416:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788830488.506001:0:8463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788830488.506037:0:8463:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e257f723c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788830488.506185:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595132416 00000100:00100000:1.0:1788830488.506192:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595132416 00000100:00100000:1.0:1788830488.506231:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788830488.506239:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2574712c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1745cc3d-3952-4cd4-9020-9b8acb483105+17:8463:x1875724595132416:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788830488.506463:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2574712c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1745cc3d-3952-4cd4-9020-9b8acb483105+17:8463:x1875724595132416:12345-0@lo:502:llog_process_th.0 Request processed in 224us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830488.506470:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788830488.507779:0:8463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e255005d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1745cc3d-3952-4cd4-9020-9b8acb483105:8463:1875724595132416:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1788830488.507828:0:8463:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1788830488.508193:0:5829:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1788830488.508214:0:5829:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.121@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788830488.508225:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: ffff9e2565729e00/0x575506951eea0b2e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea0b35 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830488.508236:0:5829:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.121@tcp lock: ffff9e2565729e00/0x575506951eea0b2e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea0b35 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788830488.508245:0:5829:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1788830488.508248:0:5829:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:1.0:1788830488.508262:0:5829:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788830488.508297:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.121@tcp lock: ffff9e25820fea00/0x575506951eea0b3c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830488.508304:0:5829:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.121@tcp lock: ffff9e25820fea00/0x575506951eea0b3c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830488.508313:0:5829:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.121@tcp lock: ffff9e25820fea00/0x575506951eea0b3c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788830488.508332:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25654e9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1745cc3d-3952-4cd4-9020-9b8acb483105:5829:1875724595132544:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788830488.508382:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830488.508414:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2553221e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788830488.508510:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595132544 00000100:00100000:0.0:1788830488.508521:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595132544 00000100:00100000:0.0:1788830488.508582:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788830488.508592:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2574710c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+17:5829:x1875724595132544:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788830488.508603:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788830488.508617:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2445b7f400/0x575506951eea0b43 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x575506951eea0b3c expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830488.508640:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2445b7f400/0x575506951eea0b43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x575506951eea0b3c expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830488.508650:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2445b7f400/0x575506951eea0b43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x575506951eea0b3c expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830488.508658:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2445b7f400, rc 0) 00000100:00100000:0.0:1788830488.508702:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2574710c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+18:5829:x1875724595132544:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 112us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830488.508727:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788830488.508988:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25654e9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1745cc3d-3952-4cd4-9020-9b8acb483105:5829:1875724595132544:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788830488.509001:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.121@tcp lock: ffff9e25820fea00/0x575506951eea0b3c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea0b43 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830488.509010:0:5829:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.121@tcp lock: ffff9e25820fea00/0x575506951eea0b3c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x575506951eea0b43 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788830488.509057:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25654e9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1745cc3d-3952-4cd4-9020-9b8acb483105:5829:1875724595132672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788830488.509084:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830488.509111:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2553221e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788830488.509228:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595132672 00000100:00100000:3.0:1788830488.509232:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595132672 00000100:00100000:3.0:1788830488.509254:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788830488.509260:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2574712050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1745cc3d-3952-4cd4-9020-9b8acb483105+18:5829:x1875724595132672:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788830488.509507:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2574712050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1745cc3d-3952-4cd4-9020-9b8acb483105+18:5829:x1875724595132672:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 246us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830488.509515:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788830488.510275:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25654e9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1745cc3d-3952-4cd4-9020-9b8acb483105:5829:1875724595132672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788830488.510315:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25654e9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1745cc3d-3952-4cd4-9020-9b8acb483105:5829:1875724595132800:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788830488.510361:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830488.510380:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2553221e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788830488.510456:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595132800 00000100:00100000:2.0:1788830488.510463:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595132800 00000100:00100000:2.0:1788830488.510502:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788830488.510511:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2574711850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1745cc3d-3952-4cd4-9020-9b8acb483105+18:5829:x1875724595132800:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788830488.510689:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2574711850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1745cc3d-3952-4cd4-9020-9b8acb483105+18:5829:x1875724595132800:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 179us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830488.510696:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788830488.511006:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25654e9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1745cc3d-3952-4cd4-9020-9b8acb483105:5829:1875724595132800:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788830488.511473:0:8464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25654e9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1745cc3d-3952-4cd4-9020-9b8acb483105:8464:1875724595132928:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788830488.511517:0:8464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830488.511546:0:8464:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2553221780 going to sleep for 11 seconds 00000100:00100000:2.0:1788830488.511661:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595132928 00000100:00100000:2.0:1788830488.511667:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595132928 00000100:00100000:2.0:1788830488.511736:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788830488.511745:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2574713050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1745cc3d-3952-4cd4-9020-9b8acb483105+18:8464:x1875724595132928:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788830488.512132:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2574713050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1745cc3d-3952-4cd4-9020-9b8acb483105+18:8464:x1875724595132928:12345-0@lo:502:llog_process_th.0 Request processed in 387us (613us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830488.512139:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1788830488.512261:0:8464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25654e9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1745cc3d-3952-4cd4-9020-9b8acb483105:8464:1875724595132928:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788830488.512290:0:8464:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788830488.512298:0:8464:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788830488.512301:0:8464:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788830488.512306:0:8464:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788830488.512329:0:8464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25654e9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1745cc3d-3952-4cd4-9020-9b8acb483105:8464:1875724595133056:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788830488.512361:0:8464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830488.512379:0:8464:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2553221780 going to sleep for 11 seconds 00000100:00100000:3.0:1788830488.512435:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595133056 00000100:00100000:3.0:1788830488.512440:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595133056 00000100:00100000:3.0:1788830488.512473:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788830488.512481:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2574710050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1745cc3d-3952-4cd4-9020-9b8acb483105+18:8464:x1875724595133056:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788830488.513049:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2574710050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1745cc3d-3952-4cd4-9020-9b8acb483105+18:8464:x1875724595133056:12345-0@lo:502:llog_process_th.0 Request processed in 567us (685us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830488.513056:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788830488.513163:0:8464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25654e9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1745cc3d-3952-4cd4-9020-9b8acb483105:8464:1875724595133056:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788830488.513185:0:8464:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788830488.513190:0:8464:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788830488.513192:0:8464:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788830488.513195:0:8464:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:2.0:1788830488.513329:0:5829:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:2.0:1788830488.513347:0:5829:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.121@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788830488.513356:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: ffff9e25820fea00/0x575506951eea0b3c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea0b43 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830488.513366:0:5829:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.121@tcp lock: ffff9e25820fea00/0x575506951eea0b3c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea0b43 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788830488.513375:0:5829:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1788830488.513377:0:5829:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9e254482b370 from 1 10000000:01000000:2.0:1788830488.513380:0:5829:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788830488.513404:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.121@tcp lock: ffff9e2565728400/0x575506951eea0b4a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830488.513412:0:5829:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.121@tcp lock: ffff9e2565728400/0x575506951eea0b4a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830488.513421:0:5829:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.121@tcp lock: ffff9e2565728400/0x575506951eea0b4a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788830488.513434:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e255005d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1745cc3d-3952-4cd4-9020-9b8acb483105:5829:1875724595133184:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788830488.513462:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788830488.513491:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e257f723a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788830488.513808:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595133184 00000100:00100000:1.0:1788830488.513880:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595133184 00000100:00100000:1.0:1788830488.513955:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788830488.513965:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255d949450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1745cc3d-3952-4cd4-9020-9b8acb483105+18:5829:x1875724595133184:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788830488.513975:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788830488.513987:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e25820fe600/0x575506951eea0b51 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x575506951eea0b4a expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830488.514009:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e25820fe600/0x575506951eea0b51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x575506951eea0b4a expref: 19 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830488.514032:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e25820fe600/0x575506951eea0b51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x575506951eea0b4a expref: 19 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830488.514040:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e25820fe600, rc 0) 00000100:00100000:1.0:1788830488.514075:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255d949450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1745cc3d-3952-4cd4-9020-9b8acb483105+19:5829:x1875724595133184:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 112us (612us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830488.514080:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788830488.514146:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e255005d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1745cc3d-3952-4cd4-9020-9b8acb483105:5829:1875724595133184:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788830488.514163:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.121@tcp lock: ffff9e2565728400/0x575506951eea0b4a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea0b51 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830488.514172:0:5829:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.121@tcp lock: ffff9e2565728400/0x575506951eea0b4a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x575506951eea0b51 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788830488.514214:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e255005d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1745cc3d-3952-4cd4-9020-9b8acb483105:5829:1875724595133312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788830488.514237:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788830488.524179:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e257f723a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788830488.524364:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595133312 00000100:00100000:0.0:1788830488.524375:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595133312 00000100:00100000:1.0:1788830488.524477:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788830488.524490:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255d949050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1745cc3d-3952-4cd4-9020-9b8acb483105+19:5829:x1875724595133312:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788830488.524829:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255d949050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1745cc3d-3952-4cd4-9020-9b8acb483105+19:5829:x1875724595133312:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 330us (10577us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788830488.524838:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788830488.530312:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e255005d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1745cc3d-3952-4cd4-9020-9b8acb483105:5829:1875724595133312:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1788830488.530373:0:5829:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.121@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788830488.530387:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: ffff9e2565728400/0x575506951eea0b4a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea0b51 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830488.530399:0:5829:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.121@tcp lock: ffff9e2565728400/0x575506951eea0b4a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea0b51 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830488.604038:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788830488.775338:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830488.775448:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578329344 00000100:00100000:2.0:1788830488.775459:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578329344 00000100:00100000:2.0:1788830488.775516:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 164 00000100:00100000:2.0:1788830488.775527:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255d94b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+8:5593:x1875724578329344:12345-192.168.201.21@tcp:101: 00010000:00010000:2.0:1788830488.775546:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788830488.775697:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2565729200/0x575506951eea0b58 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xa578910534661bee expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830488.775759:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2565729200/0x575506951eea0b58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661bee expref: 9 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830488.775912:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2565729200/0x575506951eea0b58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661bee expref: 9 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830488.775921:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2565729200, rc 0) 00000100:00100000:2.0:1788830488.775989:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255d94b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+9:5593:x1875724578329344:12345-192.168.201.21@tcp:101: Request processed in 464us (661us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830488.775996:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 164 00000100:00100000:0.0:1788830488.780083:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830488.780233:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578329472 00000100:00100000:3.0:1788830488.780245:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578329472 00000100:00100000:3.0:1788830488.780309:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 165 00000100:00100000:3.0:1788830488.780320:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255d948850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+9:5593:x1875724578329472:12345-192.168.201.21@tcp:501: 00000100:00100000:3.0:1788830488.780632:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255d948850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+9:5593:x1875724578329472:12345-192.168.201.21@tcp:501: Request processed in 313us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830488.780641:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 165 00000100:00100000:0.0:1788830488.792442:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830488.792551:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578329600 00000100:00100000:2.0:1788830488.792561:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578329600 00000100:00100000:2.0:1788830488.792642:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 166 00000100:00100000:2.0:1788830488.792653:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255d948050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+9:5593:x1875724578329600:12345-192.168.201.21@tcp:503: 00000100:00100000:2.0:1788830488.793231:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255d948050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+9:5593:x1875724578329600:12345-192.168.201.21@tcp:503: Request processed in 576us (797us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830488.793241:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 166 00000100:00100000:0.0:1788830488.805309:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830488.805412:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578329728 00000100:00100000:1.0:1788830488.805425:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578329728 00000100:00100000:1.0:1788830488.805495:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 167 00000100:00100000:1.0:1788830488.805506:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255d949c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+9:6065:x1875724578329728:12345-192.168.201.21@tcp:502: 00000100:00100000:1.0:1788830488.806076:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255d949c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+9:6065:x1875724578329728:12345-192.168.201.21@tcp:502: Request processed in 569us (775us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830488.806086:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 167 00000100:00100000:0.0:1788830488.808953:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830488.811021:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578329856 00000100:00100000:2.0:1788830488.811037:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578329856 00000100:00100000:2.0:1788830488.811131:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 168 00000100:00100000:2.0:1788830488.811143:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255d94a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+9:6065:x1875724578329856:12345-192.168.201.21@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788830488.811451:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255d94a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+9:6065:x1875724578329856:12345-192.168.201.21@tcp:502:llog_process_th.0 Request processed in 309us (2904us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830488.811459:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 168 00000100:00100000:0.0:1788830488.814894:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830488.815092:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578329984 00000100:00100000:1.0:1788830488.815103:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578329984 00000100:00100000:1.0:1788830488.815167:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 169 00000100:00100000:1.0:1788830488.815179:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255d948450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+9:5593:x1875724578329984:12345-192.168.201.21@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788830488.815201:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788830488.815236:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e25820fe200/0x575506951eea0b5f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xa578910534661bf5 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830488.815268:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e25820fe200/0x575506951eea0b5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661bf5 expref: 10 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830488.815280:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e25820fe200/0x575506951eea0b5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661bf5 expref: 10 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830488.815290:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e25820fe200, rc 0) 00000100:00100000:1.0:1788830488.815353:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255d948450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+10:5593:x1875724578329984:12345-192.168.201.21@tcp:101:ll_cfg_requeue.0 Request processed in 176us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830488.815361:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 169 00000100:00100000:0.0:1788830488.820460:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830488.820680:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578330112 00000100:00100000:2.0:1788830488.820691:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578330112 00000100:00100000:2.0:1788830488.820926:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 170 00000100:00100000:2.0:1788830488.820952:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255d94ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+10:5593:x1875724578330112:12345-192.168.201.21@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788830488.821284:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255d94ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+10:5593:x1875724578330112:12345-192.168.201.21@tcp:501:ll_cfg_requeue.0 Request processed in 333us (835us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788830488.821293:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 170 00000100:00100000:3.0:1788830489.308106:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788830489.308143:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257fa65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875724595133440:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788830489.308257:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830489.308677:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595133440 00000100:00100000:0.0:1788830489.308689:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595133440 00000100:00100000:0.0:1788830489.308816:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788830489.308828:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257f724380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875724595133440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788830489.308888:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788830489.308968:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257f724380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875724595133440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 142us (710us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830489.308976:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1788830489.309027:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e257fa65500 x1875724595133440/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788830505 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788830489.309051:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257fa65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875724595133440:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788830489.309365:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788830489.629841:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788830490.087074:0:8502:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe9bf78c20 20000000:00000080:3.0:1788830490.087097:0:8502:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9e2565701c00 uarg=0000000000000000 20000000:01000000:3.0:1788830490.087146:0:8502:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788830490.087154:0:8502:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788830490.087160:0:8502:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1788830490.088501:0:8503:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:0.0:1788830490.089017:0:8502:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:0.0:1788830490.094123:0:8502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:0.0:1788830490.094198:0:8502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:0.0:1788830490.094259:0:8502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:0.0:1788830490.094281:0:8502:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788830490.094309:0:8502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2445b7ee00/0x575506951eea0b66 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830490.094330:0:8502:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e257d944200/0x575506951eea0952 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x575506951eea094b expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830490.094340:0:8502:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e25820ffe00/0x575506951eea097c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x575506951eea0975 expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830490.094348:0:8502:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2540030a00/0x575506951eea0a08 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x575506951eea0a01 expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830490.094359:0:8502:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e257d944000/0x575506951eea0ac5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661bbd expref: 9 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830490.094368:0:8502:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2445b7ee00/0x575506951eea0b66 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830490.094436:0:8502:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e257d944000/0x575506951eea0ac5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.201.21@tcp remote: 0xa578910534661bbd expref: 9 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830490.094454:0:8502:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e257d944000/0x575506951eea0ac5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661bbd expref: 9 pid: 5826 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788830490.094473:0:8502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257fa65500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8502:1875724595133568:192.168.201.21@tcp:104: 00010000:00010000:0.0:1788830490.094605:0:8502:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2540030a00/0x575506951eea0a08 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x575506951eea0a01 expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830490.094615:0:8502:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e2540030a00/0x575506951eea0a08 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x575506951eea0a01 expref: 18 pid: 5824 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788830490.094625:0:8502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257fa66680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8502:1875724595133696:0@lo:104: 00000100:00100000:0.0:1788830490.094677:0:8502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788830490.094825:0:8502:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e25820ffe00/0x575506951eea097c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x575506951eea0975 expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830490.094835:0:8502:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e25820ffe00/0x575506951eea097c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x575506951eea0975 expref: 18 pid: 5824 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788830490.094843:0:8502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257fa64e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8502:1875724595133824:0@lo:104: 00010000:00010000:0.0:1788830490.094872:0:8502:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e257d944200/0x575506951eea0952 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x575506951eea094b expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830490.094881:0:8502:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e257d944200/0x575506951eea0952 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x575506951eea094b expref: 18 pid: 5826 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788830490.094901:0:8502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257fa65f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8502:1875724595133952:0@lo:104: 00000100:00100000:0.0:1788830490.094938:0:8502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2545cc9600 going to sleep for 11 seconds 00000100:00100000:3.0:1788830490.095635:0:5816:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788830490.095665:0:5816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830490.095889:0:5816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788830490.096119:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595133696 00000100:00100000:2.0:1788830490.096131:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595133696 00000100:00100000:2.0:1788830490.096185:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595133824 00000100:00100000:2.0:1788830490.096188:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595133824 00000100:00100000:2.0:1788830490.096199:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595133952 00000100:00100000:2.0:1788830490.096202:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595133952 00000100:00100000:2.0:1788830490.096215:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788830490.096225:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2565488450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1745cc3d-3952-4cd4-9020-9b8acb483105+5:8502:x1875724595133696:12345-0@lo:104: 00010000:00010000:2.0:1788830490.096246:0:5815:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.121@tcp lock: ffff9e257d944800/0x575506951eea0a01 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x575506951eea0a08 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830490.096378:0:5815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788830490.096385:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2565488450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1745cc3d-3952-4cd4-9020-9b8acb483105+5:8502:x1875724595133696:12345-0@lo:104: Request processed in 162us (1709us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830490.096393:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788830490.096443:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788830490.096450:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257f726300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1745cc3d-3952-4cd4-9020-9b8acb483105+4:8502:x1875724595133824:12345-0@lo:104: 00010000:00010000:2.0:1788830490.096458:0:5815:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.121@tcp lock: ffff9e257d944400/0x575506951eea0975 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x575506951eea097c expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788830490.096554:0:8502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257fa66680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8502:1875724595133696:0@lo:104: 00000100:00100000:0.0:1788830490.096565:0:8502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257fa64e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8502:1875724595133824:0@lo:104: 00000100:00100000:3.0:1788830490.096640:0:5816:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:3.0:1788830490.096649:0:5816:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00000100:00100000:3.0:1788830490.097182:0:8504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788830490.097194:0:8504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257f724000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:1745cc3d-3952-4cd4-9020-9b8acb483105+4:8502:x1875724595133952:12345-0@lo:104: 00010000:00010000:3.0:1788830490.097204:0:8504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.121@tcp lock: ffff9e257d80e800/0x575506951eea094b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x575506951eea0952 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830490.097285:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788830490.097295:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.121@tcp lock: ffff9e257d944800/0x575506951eea0a01 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x575506951eea0a08 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830490.097304:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e257d944800 already unused, calling callback (ffffffffc1aebc20) 10000000:00010000:1.0:1788830490.097309:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.121@tcp lock: ffff9e257d944800/0x575506951eea0a01 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x575506951eea0a08 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830490.097319:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.121@tcp lock: ffff9e257d944800/0x575506951eea0a01 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x575506951eea0a08 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788830490.097327:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.121@tcp lock: ffff9e257d944800/0x575506951eea0a01 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x575506951eea0a08 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788830490.097334:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788830490.097381:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.121@tcp lock: ffff9e257d944800/0x575506951eea0a01 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x575506951eea0a08 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830490.097396:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788830490.097420:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.121@tcp lock: ffff9e257d944800/0x575506951eea0a01 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x575506951eea0a08 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830490.097427:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.121@tcp lock: ffff9e257d944800/0x575506951eea0a01 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x575506951eea0a08 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830490.097441:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788830490.097445:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.121@tcp lock: ffff9e257d944400/0x575506951eea0975 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x575506951eea097c expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830490.097451:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e257d944400 already unused, calling callback (ffffffffc1aebc20) 10000000:00010000:1.0:1788830490.097454:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.121@tcp lock: ffff9e257d944400/0x575506951eea0975 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x575506951eea097c expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830490.097461:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.121@tcp lock: ffff9e257d944400/0x575506951eea0975 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x575506951eea097c expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788830490.097467:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.121@tcp lock: ffff9e257d944400/0x575506951eea0975 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x575506951eea097c expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788830490.097473:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788830490.097486:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.121@tcp lock: ffff9e257d944400/0x575506951eea0975 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x575506951eea097c expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830490.097492:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788830490.097506:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.121@tcp lock: ffff9e257d944400/0x575506951eea0975 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x575506951eea097c expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830490.097513:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.121@tcp lock: ffff9e257d944400/0x575506951eea0975 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x575506951eea097c expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830490.097529:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788830490.097532:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.121@tcp lock: ffff9e257d80e800/0x575506951eea094b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x575506951eea0952 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830490.097538:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e257d80e800 already unused, calling callback (ffffffffc1aebc20) 10000000:00010000:1.0:1788830490.097541:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.121@tcp lock: ffff9e257d80e800/0x575506951eea094b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x575506951eea0952 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830490.097547:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.121@tcp lock: ffff9e257d80e800/0x575506951eea094b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x575506951eea0952 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788830490.097553:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.121@tcp lock: ffff9e257d80e800/0x575506951eea094b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x575506951eea0952 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788830490.097559:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788830490.097572:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.121@tcp lock: ffff9e257d80e800/0x575506951eea094b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x575506951eea0952 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830490.097578:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788830490.097584:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.121@tcp lock: ffff9e257d80e800/0x575506951eea094b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x575506951eea0952 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830490.097589:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.121@tcp lock: ffff9e257d80e800/0x575506951eea094b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x575506951eea0952 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830490.097607:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788830490.097609:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788830490.097611:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788830490.097623:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788830490.097644:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25654e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1745cc3d-3952-4cd4-9020-9b8acb483105:3309:1875724595134080:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788830490.097977:0:5815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:2.0:1788830490.097987:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257f726300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1745cc3d-3952-4cd4-9020-9b8acb483105+4:8502:x1875724595133824:12345-0@lo:104: Request processed in 1537us (2321us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830490.097995:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:2.0:1788830490.098065:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788830490.098130:0:8504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:3.0:1788830490.098138:0:8504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257f724000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:1745cc3d-3952-4cd4-9020-9b8acb483105+3:8502:x1875724595133952:12345-0@lo:104: Request processed in 946us (2248us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830490.098146:0:8504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00010000:2.0:1788830490.098199:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788830490.098247:0:8502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257fa65f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8502:1875724595133952:0@lo:104: 00000100:00100000:1.0:1788830490.098321:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830490.098415:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25654ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1745cc3d-3952-4cd4-9020-9b8acb483105:3307:1875724595134208:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788830490.098444:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830490.098517:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788830490.098524:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25654e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1745cc3d-3952-4cd4-9020-9b8acb483105:3307:1875724595134336:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788830490.098546:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830490.098594:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595134080 00000100:00100000:0.0:1788830490.098602:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595134080 00010000:00010000:0.0:1788830490.098639:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2540030a00/0x575506951eea0a08 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x575506951eea0a01 expref: 19 pid: 5824 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788830490.098684:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595134208 00000100:00100000:0.0:1788830490.098688:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595134208 00010000:00010000:0.0:1788830490.098701:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e25820ffe00/0x575506951eea097c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x575506951eea0975 expref: 20 pid: 5824 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788830490.098740:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788830490.098749:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25654e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1745cc3d-3952-4cd4-9020-9b8acb483105+20:3309:x1875724595134080:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788830490.098764:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788830490.098769:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2540030a00/0x575506951eea0a08 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x575506951eea0a01 expref: 20 pid: 5824 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830490.098779:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2540030a00/0x575506951eea0a08 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x575506951eea0a01 expref: 20 pid: 5824 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830490.098796:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2540030a00/0x575506951eea0a08 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x575506951eea0a01 expref: 20 pid: 5824 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830490.098815:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788830490.098859:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25654e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1745cc3d-3952-4cd4-9020-9b8acb483105+19:3309:x1875724595134080:12345-0@lo:103:ldlm_bl.0 Request processed in 111us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830490.098866:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788830490.098883:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788830490.098888:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25654eb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1745cc3d-3952-4cd4-9020-9b8acb483105+18:3307:x1875724595134208:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788830490.098896:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788830490.098900:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e25820ffe00/0x575506951eea097c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x575506951eea0975 expref: 18 pid: 5824 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830490.098909:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e25820ffe00/0x575506951eea097c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x575506951eea0975 expref: 18 pid: 5824 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830490.098935:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e25820ffe00/0x575506951eea097c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x575506951eea0975 expref: 18 pid: 5824 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830490.098945:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788830490.098966:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25654eb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1745cc3d-3952-4cd4-9020-9b8acb483105+17:3307:x1875724595134208:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830490.098972:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788830490.099003:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25654e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1745cc3d-3952-4cd4-9020-9b8acb483105:3309:1875724595134080:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788830490.099299:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25654ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1745cc3d-3952-4cd4-9020-9b8acb483105:3307:1875724595134208:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788830490.099372:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595134336 00000100:00100000:0.0:1788830490.099377:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595134336 00010000:00010000:0.0:1788830490.099396:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e257d944200/0x575506951eea0952 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x575506951eea094b expref: 17 pid: 5826 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788830490.099462:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788830490.099470:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25654e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1745cc3d-3952-4cd4-9020-9b8acb483105+17:3307:x1875724595134336:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788830490.099479:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788830490.099491:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e257d944200/0x575506951eea0952 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x575506951eea094b expref: 17 pid: 5826 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830490.099501:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e257d944200/0x575506951eea0952 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x575506951eea094b expref: 17 pid: 5826 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830490.099512:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e257d944200/0x575506951eea0952 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x575506951eea094b expref: 17 pid: 5826 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830490.099523:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788830490.099560:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25654e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1745cc3d-3952-4cd4-9020-9b8acb483105+16:3307:x1875724595134336:12345-0@lo:103:ldlm_bl.0 Request processed in 92us (1013us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830490.099566:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788830490.099613:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25654e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1745cc3d-3952-4cd4-9020-9b8acb483105:3307:1875724595134336:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788830490.103084:0:8502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257fa65500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8502:1875724595133568:192.168.201.21@tcp:104: 00010000:00010000:2.0:1788830490.103138:0:8502:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2445b7ee00/0x575506951eea0b66 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788830490.105532:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830490.106148:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578330240 00000100:00100000:2.0:1788830490.106164:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578330240 00010000:00010000:2.0:1788830490.106217:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e257d944000/0x575506951eea0ac5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661bbd expref: 10 pid: 5826 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788830490.106311:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 24 00000100:00100000:2.0:1788830490.106324:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257fa67480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+10:2355:x1875724578330240:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788830490.106343:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788830490.106350:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e257d944000/0x575506951eea0ac5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661bbd expref: 10 pid: 5826 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830490.106367:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e257d944000/0x575506951eea0ac5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661bbd expref: 10 pid: 5826 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830490.106391:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e257d944000/0x575506951eea0ac5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661bbd expref: 10 pid: 5826 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830490.106414:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2445b7ee00/0x575506951eea0b66 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830490.106423:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2445b7ee00/0x575506951eea0b66 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830490.106445:0:5819:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2445b7ee00/0x575506951eea0b66 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830490.106472:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2445b7ee00/0x575506951eea0b66 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830490.106480:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2445b7ee00/0x575506951eea0b66 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830490.106487:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2445b7ee00/0x575506951eea0b66 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830490.106494:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2445b7ee00 already unused, calling callback (ffffffffc14cb350) 00010000:00010000:2.0:1788830490.106499:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2445b7ee00/0x575506951eea0b66 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830490.106508:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2445b7ee00/0x575506951eea0b66 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830490.106536:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2445b7ee00/0x575506951eea0b66 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830490.106550:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788830490.106679:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257fa67480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+9:2355:x1875724578330240:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 356us (1160us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830490.106688:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 24 00010000:00010000:3.0:1788830490.106786:0:8502:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2445b7ee00/0x575506951eea0b66 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830490.106796:0:8502:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2445b7ee00/0x575506951eea0b66 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830490.106802:0:8502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2445b7ee00/0x575506951eea0b66 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788830490.332487:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257fa66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1875724595134720:0@lo:400:kworker.0 00000100:00100000:3.0:1788830490.332616:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788830490.332889:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257fa66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875724595134592:0@lo:400:kworker.0 00000100:00100000:2.0:1788830490.332940:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788830490.332983:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788830490.332990:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257fa64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875724595134464:0@lo:400:kworker.0 00000100:00100000:3.0:1788830490.333202:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788830490.333210:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257fa67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1875724595134848:0@lo:400:kworker.0 00000100:00100000:3.0:1788830490.333246:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830490.333304:0:8202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595134720 00000100:00100000:3.0:1788830490.333314:0:8202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595134720 00000100:00100000:3.0:1788830490.333382:0:8202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595134848 00000100:00100000:3.0:1788830490.333386:0:8202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595134848 00000100:00100000:3.0:1788830490.333415:0:8202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788830490.333425:0:8202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257f727b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875724595134720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788830490.333481:0:8202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257f727b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875724595134720:12345-0@lo:400:kworker.0 Request processed in 57us (866us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830490.333486:0:8202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788830490.333500:0:8202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788830490.333504:0:8202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257f725c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875724595134848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788830490.333520:0:8202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257f725c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875724595134848:12345-0@lo:400:kworker.0 Request processed in 16us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830490.333524:0:8202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:3.0:1788830490.333535:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788830490.333570:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257fa67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1875724595134848:0@lo:400:kworker.0 00000100:00100000:3.0:1788830490.333578:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257fa66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1875724595134720:0@lo:400:kworker.0 00000100:00100000:2.0:1788830490.333828:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788830490.333860:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788830490.333869:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257fa64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875724595134976:0@lo:400:kworker.0 00000100:00100000:2.0:1788830490.333897:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788830490.333948:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595134592 00000100:00100000:2.0:1788830490.333953:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595134592 00000100:00100000:2.0:1788830490.333982:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595134976 00000100:00100000:2.0:1788830490.333985:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595134976 00000100:00100000:1.0:1788830490.334151:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595134464 00000100:00100000:1.0:1788830490.334156:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595134464 00000100:00100000:1.0:1788830490.334188:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788830490.334198:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255005d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875724595134464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788830490.334256:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255005d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875724595134464:12345-0@lo:400:kworker.0 Request processed in 59us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830490.334263:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788830490.334388:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788830490.334400:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255005d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875724595134592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788830490.334441:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255005d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875724595134592:12345-0@lo:400:kworker.0 Request processed in 45us (1500us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830490.334447:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788830490.334532:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788830490.334540:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255005f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875724595134976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788830490.334576:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255005f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875724595134976:12345-0@lo:400:kworker.0 Request processed in 38us (678us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830490.334583:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:2.0:1788830490.334621:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e257fa64700 x1875724595134976/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788830506 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788830490.334634:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257fa64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875724595134976:0@lo:400:kworker.0 00000100:00100000:2.0:1788830490.334647:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257fa64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875724595134464:0@lo:400:kworker.0 00010000:00080000:2.0:1788830490.334659:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e257fa66a00 x1875724595134592/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788830506 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788830490.334667:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257fa66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875724595134592:0@lo:400:kworker.0 00000100:00080000:0.0:1788830490.334821:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788830490.486414:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830490.486640:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578330368 00000100:00100000:3.0:1788830490.486652:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578330368 00000100:00100000:3.0:1788830490.486745:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 171 00000100:00100000:3.0:1788830490.486755:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2574711450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+9:5593:x1875724578330368:12345-192.168.201.21@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788830490.486774:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788830490.486813:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e257d944a00/0x575506951eea0b6d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa578910534661bfc expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830490.486850:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e257d944a00/0x575506951eea0b6d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661bfc expref: 10 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830490.486874:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e257d944a00/0x575506951eea0b6d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661bfc expref: 10 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830490.486887:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e257d944a00, rc 0) 00000100:00100000:3.0:1788830490.486965:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2574711450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+10:5593:x1875724578330368:12345-192.168.201.21@tcp:101:ll_cfg_requeue.0 Request processed in 212us (569us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830490.486970:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 171 00000100:00100000:3.0:1788830490.489338:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830490.489450:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578330496 00000100:00100000:2.0:1788830490.489463:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578330496 00000100:00100000:2.0:1788830490.489519:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 172 00000100:00100000:2.0:1788830490.489528:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255d948c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+10:5593:x1875724578330496:12345-192.168.201.21@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788830490.491107:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255d948c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+10:5593:x1875724578330496:12345-192.168.201.21@tcp:501:ll_cfg_requeue.0 Request processed in 1568us (1782us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830490.491130:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 172 00000100:00100000:1.0:1788830490.501410:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830490.508550:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578330624 00000100:00100000:3.0:1788830490.508576:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578330624 00000100:00100000:1.0:1788830490.519404:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 173 00000100:00100000:1.0:1788830490.519423:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255d94b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+10:5593:x1875724578330624:12345-192.168.201.21@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788830490.519789:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255d94b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+10:5593:x1875724578330624:12345-192.168.201.21@tcp:503:ll_cfg_requeue.0 Request processed in 370us (18394us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830490.519799:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 173 00000100:00100000:3.0:1788830490.525209:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830490.536298:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578330752 00000100:00100000:2.0:1788830490.536323:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578330752 00000100:00100000:2.0:1788830490.537974:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 174 00000100:00100000:2.0:1788830490.540143:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255d94a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+10:6122:x1875724578330752:12345-192.168.201.21@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788830490.540578:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255d94a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+10:6122:x1875724578330752:12345-192.168.201.21@tcp:502:llog_process_th.0 Request processed in 2584us (15382us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830490.540590:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 174 00000100:00100000:2.0:1788830490.546257:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830490.546896:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578330880 00000100:00100000:1.0:1788830490.546921:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578330880 00000100:00100000:1.0:1788830490.547006:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 175 00000100:00100000:1.0:1788830490.547033:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255d949850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+10:6122:x1875724578330880:12345-192.168.201.21@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788830490.547966:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255d949850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+10:6122:x1875724578330880:12345-192.168.201.21@tcp:502:llog_process_th.0 Request processed in 927us (1709us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830490.547977:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 175 00010000:00010000:2.0:1788830490.656737:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788830490.844823:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e255005c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875724595135104:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788830490.844932:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830490.845879:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595135104 00000100:00100000:0.0:1788830490.845896:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595135104 00000100:00100000:0.0:1788830490.846750:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788830490.846784:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257f725500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875724595135104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788830490.846842:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788830490.846963:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257f725500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875724595135104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 199us (2032us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830490.846972:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:0.0:1788830490.847672:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e255005c380 x1875724595135104/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788830506 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788830490.847705:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e255005c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875724595135104:0@lo:13:osp-pre-1-0.0 10000000:01000000:0.0:1788830491.295815:0:5829:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788830491.295825:0:5829:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e2444ab0800 from 4 10000000:01000000:0.0:1788830491.295830:0:5829:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788830491.295900:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.121@tcp lock: ffff9e2445b7f800/0x575506951eea0b74 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830491.295913:0:5829:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.121@tcp lock: ffff9e2445b7f800/0x575506951eea0b74 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830491.295926:0:5829:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.121@tcp lock: ffff9e2445b7f800/0x575506951eea0b74 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788830491.295955:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257fa65880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1745cc3d-3952-4cd4-9020-9b8acb483105:5829:1875724595135232:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788830491.296027:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830491.296082:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e256578a900 going to sleep for 11 seconds 00000100:00100000:1.0:1788830491.296168:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595135232 00000100:00100000:1.0:1788830491.296176:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595135232 00000100:00100000:1.0:1788830491.296240:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1788830491.296251:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255d94b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+16:5829:x1875724595135232:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788830491.296265:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788830491.296279:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e25820ff400/0x575506951eea0b7b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x575506951eea0b74 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830491.296303:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e25820ff400/0x575506951eea0b7b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x575506951eea0b74 expref: 17 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830491.296313:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e25820ff400/0x575506951eea0b7b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x575506951eea0b74 expref: 17 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830491.296322:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e25820ff400, rc 0) 00000100:00100000:1.0:1788830491.296362:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255d94b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+17:5829:x1875724595135232:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830491.296368:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1788830491.302516:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257fa65880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1745cc3d-3952-4cd4-9020-9b8acb483105:5829:1875724595135232:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788830491.302545:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.121@tcp lock: ffff9e2445b7f800/0x575506951eea0b74 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea0b7b expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830491.302558:0:5829:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.121@tcp lock: ffff9e2445b7f800/0x575506951eea0b74 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x575506951eea0b7b expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788830491.302640:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257fa65880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1745cc3d-3952-4cd4-9020-9b8acb483105:5829:1875724595135360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788830491.302698:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830491.302761:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e256578a900 going to sleep for 11 seconds 00000100:00100000:1.0:1788830491.302836:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595135360 00000100:00100000:1.0:1788830491.302842:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595135360 00000100:00100000:1.0:1788830491.302902:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1788830491.302912:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255d94a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1745cc3d-3952-4cd4-9020-9b8acb483105+17:5829:x1875724595135360:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788830491.303163:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255d94a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1745cc3d-3952-4cd4-9020-9b8acb483105+17:5829:x1875724595135360:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 252us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830491.303177:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1788830491.305008:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257fa65880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1745cc3d-3952-4cd4-9020-9b8acb483105:5829:1875724595135360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788830491.305071:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257fa65880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1745cc3d-3952-4cd4-9020-9b8acb483105:5829:1875724595135488:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788830491.305140:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830491.305185:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e256578a900 going to sleep for 11 seconds 00000100:00100000:1.0:1788830491.305273:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595135488 00000100:00100000:1.0:1788830491.305280:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595135488 00000100:00100000:1.0:1788830491.305329:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1788830491.305338:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255d94bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1745cc3d-3952-4cd4-9020-9b8acb483105+17:5829:x1875724595135488:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788830491.305546:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255d94bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1745cc3d-3952-4cd4-9020-9b8acb483105+17:5829:x1875724595135488:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 208us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830491.305554:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1788830491.305636:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257fa65880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1745cc3d-3952-4cd4-9020-9b8acb483105:5829:1875724595135488:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788830491.307369:0:8556:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257fa65880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1745cc3d-3952-4cd4-9020-9b8acb483105:8556:1875724595135616:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788830491.307446:0:8556:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830491.307491:0:8556:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e256578a9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788830491.307538:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595135616 00000100:00100000:1.0:1788830491.307544:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595135616 00000100:00100000:1.0:1788830491.307592:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1788830491.307602:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25474a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+17:8556:x1875724595135616:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788830491.307845:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25474a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+17:8556:x1875724595135616:12345-0@lo:502:llog_process_th.0 Request processed in 244us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830491.307853:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1788830491.307951:0:8556:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257fa65880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1745cc3d-3952-4cd4-9020-9b8acb483105:8556:1875724595135616:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788830491.307981:0:8556:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788830491.307991:0:8556:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788830491.307994:0:8556:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788830491.308001:0:8556:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e2444ab0800 00000020:00000080:3.0:1788830491.308004:0:8556:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788830491.308086:0:8556:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257f726680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1745cc3d-3952-4cd4-9020-9b8acb483105:8556:1875724595135744:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788830491.308121:0:8556:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830491.308139:0:8556:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2550b87c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788830491.308207:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595135744 00000100:00100000:0.0:1788830491.308212:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595135744 00000100:00100000:0.0:1788830491.308246:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1788830491.308252:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25474aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1745cc3d-3952-4cd4-9020-9b8acb483105+17:8556:x1875724595135744:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788830491.308381:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25474aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1745cc3d-3952-4cd4-9020-9b8acb483105+17:8556:x1875724595135744:12345-0@lo:502:llog_process_th.0 Request processed in 128us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830491.308388:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1788830491.308461:0:8556:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257f726680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1745cc3d-3952-4cd4-9020-9b8acb483105:8556:1875724595135744:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788830491.308478:0:8556:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788830491.308483:0:8556:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788830491.308485:0:8556:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1788830491.308488:0:8556:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1788830491.313812:0:5829:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1788830491.313862:0:5829:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788830491.313877:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: ffff9e2445b7f800/0x575506951eea0b74 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea0b7b expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830491.313901:0:5829:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.121@tcp lock: ffff9e2445b7f800/0x575506951eea0b74 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea0b7b expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788830491.313913:0:5829:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788830491.313915:0:5829:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e2565dcd800 from 4 10000000:01000000:0.0:1788830491.313918:0:5829:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788830491.313963:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.121@tcp lock: ffff9e2445b7ec00/0x575506951eea0b82 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830491.313984:0:5829:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.121@tcp lock: ffff9e2445b7ec00/0x575506951eea0b82 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830491.313995:0:5829:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.121@tcp lock: ffff9e2445b7ec00/0x575506951eea0b82 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788830491.314021:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257fa65180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1745cc3d-3952-4cd4-9020-9b8acb483105:5829:1875724595135872:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788830491.314093:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830491.314146:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e256578ad80 going to sleep for 11 seconds 00000100:00100000:0.0:1788830491.314172:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595135872 00000100:00100000:0.0:1788830491.314178:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595135872 00000100:00100000:0.0:1788830491.314217:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1788830491.314224:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25474ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1745cc3d-3952-4cd4-9020-9b8acb483105+17:5829:x1875724595135872:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788830491.314236:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788830491.314247:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2445b7e200/0x575506951eea0b89 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x575506951eea0b82 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830491.314269:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2445b7e200/0x575506951eea0b89 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x575506951eea0b82 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830491.314279:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2445b7e200/0x575506951eea0b89 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x575506951eea0b82 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830491.314287:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2445b7e200, rc 0) 00000100:00100000:0.0:1788830491.314319:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25474ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1745cc3d-3952-4cd4-9020-9b8acb483105+18:5829:x1875724595135872:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 94us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830491.314325:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1788830491.314373:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257fa65180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1745cc3d-3952-4cd4-9020-9b8acb483105:5829:1875724595135872:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788830491.314385:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.121@tcp lock: ffff9e2445b7ec00/0x575506951eea0b82 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea0b89 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830491.314394:0:5829:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.121@tcp lock: ffff9e2445b7ec00/0x575506951eea0b82 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x575506951eea0b89 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788830491.314437:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257fa65180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1745cc3d-3952-4cd4-9020-9b8acb483105:5829:1875724595136000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788830491.314457:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830491.314471:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e257fc23240 going to sleep for 11 seconds 00000100:00100000:0.0:1788830491.314481:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595136000 00000100:00100000:0.0:1788830491.314484:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595136000 00000100:00100000:0.0:1788830491.314501:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1788830491.314506:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25474a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+18:5829:x1875724595136000:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788830491.314776:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25474a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+18:5829:x1875724595136000:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 267us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830491.314783:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1788830491.314812:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257fa65180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1745cc3d-3952-4cd4-9020-9b8acb483105:5829:1875724595136000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788830491.314839:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257fa65180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1745cc3d-3952-4cd4-9020-9b8acb483105:5829:1875724595136128:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788830491.314875:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830491.314887:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e257fc23240 going to sleep for 11 seconds 00000100:00100000:0.0:1788830491.314908:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595136128 00000100:00100000:0.0:1788830491.314912:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595136128 00000100:00100000:0.0:1788830491.314938:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1788830491.314944:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25474aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1745cc3d-3952-4cd4-9020-9b8acb483105+18:5829:x1875724595136128:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788830491.315071:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25474aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1745cc3d-3952-4cd4-9020-9b8acb483105+18:5829:x1875724595136128:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 126us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830491.315082:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1788830491.315116:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257fa65180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1745cc3d-3952-4cd4-9020-9b8acb483105:5829:1875724595136128:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788830491.315280:0:8558:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257fa65180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1745cc3d-3952-4cd4-9020-9b8acb483105:8558:1875724595136256:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788830491.315311:0:8558:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830491.315327:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595136256 00000100:00100000:0.0:1788830491.315331:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595136256 00000100:00100000:0.0:1788830491.315352:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1788830491.315358:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25747bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1745cc3d-3952-4cd4-9020-9b8acb483105+18:8558:x1875724595136256:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788830491.315483:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25747bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1745cc3d-3952-4cd4-9020-9b8acb483105+18:8558:x1875724595136256:12345-0@lo:502:llog_process_th.0 Request processed in 124us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830491.315489:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1788830491.315515:0:8558:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e257fc230c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788830491.315526:0:8558:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257fa65180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1745cc3d-3952-4cd4-9020-9b8acb483105:8558:1875724595136256:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788830491.315546:0:8558:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788830491.315555:0:8558:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788830491.315557:0:8558:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788830491.315565:0:8558:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e2565dcd800 00000020:00000080:0.0:1788830491.315567:0:8558:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788830491.316107:0:8558:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257fa65180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1745cc3d-3952-4cd4-9020-9b8acb483105:8558:1875724595136384:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788830491.316152:0:8558:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830491.316174:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595136384 00000100:00100000:0.0:1788830491.316178:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595136384 00000100:00100000:0.0:1788830491.316200:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1788830491.316206:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25747bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+18:8558:x1875724595136384:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788830491.316321:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25747bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+18:8558:x1875724595136384:12345-0@lo:502:llog_process_th.0 Request processed in 115us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830491.316332:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1788830491.316362:0:8558:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e25429eda80 going to sleep for 11 seconds 00000100:00100000:0.0:1788830491.316377:0:8558:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257fa65180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1745cc3d-3952-4cd4-9020-9b8acb483105:8558:1875724595136384:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788830491.316393:0:8558:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788830491.316398:0:8558:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788830491.316400:0:8558:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1788830491.316403:0:8558:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1788830491.316446:0:5829:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1788830491.316462:0:5829:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788830491.316471:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: ffff9e2445b7ec00/0x575506951eea0b82 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea0b89 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830491.316481:0:5829:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.121@tcp lock: ffff9e2445b7ec00/0x575506951eea0b82 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea0b89 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788830491.316491:0:5829:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788830491.316494:0:5829:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e255d9b0800 from 4 10000000:01000000:0.0:1788830491.316497:0:5829:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788830491.316518:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.121@tcp lock: ffff9e2445b7e400/0x575506951eea0b90 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830491.316526:0:5829:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.121@tcp lock: ffff9e2445b7e400/0x575506951eea0b90 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830491.316534:0:5829:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.121@tcp lock: ffff9e2445b7e400/0x575506951eea0b90 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788830491.316546:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257fa65180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1745cc3d-3952-4cd4-9020-9b8acb483105:5829:1875724595136512:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788830491.316570:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830491.316589:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2565b94000 going to sleep for 11 seconds 00000100:00100000:0.0:1788830491.316601:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595136512 00000100:00100000:0.0:1788830491.316605:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595136512 00000100:00100000:0.0:1788830491.316624:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1788830491.316629:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25747bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1745cc3d-3952-4cd4-9020-9b8acb483105+18:5829:x1875724595136512:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788830491.316636:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788830491.316647:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2445b7fc00/0x575506951eea0b97 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x575506951eea0b90 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830491.316667:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2445b7fc00/0x575506951eea0b97 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x575506951eea0b90 expref: 19 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830491.316677:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2445b7fc00/0x575506951eea0b97 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x575506951eea0b90 expref: 19 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830491.316685:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2445b7fc00, rc 0) 00000100:00100000:0.0:1788830491.316734:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25747bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1745cc3d-3952-4cd4-9020-9b8acb483105+19:5829:x1875724595136512:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 103us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830491.316739:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1788830491.316770:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257fa65180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1745cc3d-3952-4cd4-9020-9b8acb483105:5829:1875724595136512:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788830491.316781:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.121@tcp lock: ffff9e2445b7e400/0x575506951eea0b90 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea0b97 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830491.316789:0:5829:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.121@tcp lock: ffff9e2445b7e400/0x575506951eea0b90 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x575506951eea0b97 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788830491.316826:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257fa65180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1745cc3d-3952-4cd4-9020-9b8acb483105:5829:1875724595136640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788830491.316850:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830491.316870:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2565b94000 going to sleep for 11 seconds 00000100:00100000:0.0:1788830491.316881:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595136640 00000100:00100000:0.0:1788830491.316884:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595136640 00000100:00100000:0.0:1788830491.322232:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1788830491.322249:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25747bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1745cc3d-3952-4cd4-9020-9b8acb483105+19:5829:x1875724595136640:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788830491.322568:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25747bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1745cc3d-3952-4cd4-9020-9b8acb483105+19:5829:x1875724595136640:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 324us (5715us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830491.322576:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1788830491.322627:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257fa65180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1745cc3d-3952-4cd4-9020-9b8acb483105:5829:1875724595136640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788830491.324960:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257fa65180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1745cc3d-3952-4cd4-9020-9b8acb483105:5829:1875724595136768:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788830491.325046:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830491.325091:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2565b94000 going to sleep for 11 seconds 00000100:00100000:0.0:1788830491.325114:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595136768 00000100:00100000:0.0:1788830491.325122:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595136768 00000100:00100000:0.0:1788830491.325170:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1788830491.325180:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25747bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+19:5829:x1875724595136768:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788830491.325379:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25747bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+19:5829:x1875724595136768:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 200us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830491.325387:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1788830491.325444:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257fa65180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1745cc3d-3952-4cd4-9020-9b8acb483105:5829:1875724595136768:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788830491.333009:0:8559:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257f726680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1745cc3d-3952-4cd4-9020-9b8acb483105:8559:1875724595136896:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788830491.333111:0:8559:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830491.334863:0:8559:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2550b87300 going to sleep for 11 seconds 00000100:00100000:1.0:1788830491.337030:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595136896 00000100:00100000:1.0:1788830491.337048:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595136896 00000100:00100000:1.0:1788830491.337115:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1788830491.337125:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25747bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+19:8559:x1875724595136896:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788830491.337374:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25747bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+19:8559:x1875724595136896:12345-0@lo:502:llog_process_th.0 Request processed in 250us (4262us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830491.337381:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1788830491.337477:0:8559:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257f726680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1745cc3d-3952-4cd4-9020-9b8acb483105:8559:1875724595136896:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788830491.337509:0:8559:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788830491.337518:0:8559:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788830491.337521:0:8559:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788830491.337527:0:8559:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e255d9b0800 00000020:00000080:3.0:1788830491.337530:0:8559:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788830491.337620:0:8559:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257f726680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1745cc3d-3952-4cd4-9020-9b8acb483105:8559:1875724595137024:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788830491.337676:0:8559:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830491.337873:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595137024 00000100:00100000:0.0:1788830491.337878:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595137024 00000100:00100000:0.0:1788830491.337913:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1788830491.337921:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25747bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1745cc3d-3952-4cd4-9020-9b8acb483105+19:8559:x1875724595137024:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788830491.338040:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25747bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1745cc3d-3952-4cd4-9020-9b8acb483105+19:8559:x1875724595137024:12345-0@lo:502:llog_process_th.0 Request processed in 120us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830491.338054:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1788830491.339092:0:8559:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2550b87300 going to sleep for 11 seconds 00000100:00100000:0.0:1788830491.339119:0:8559:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257f726680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1745cc3d-3952-4cd4-9020-9b8acb483105:8559:1875724595137024:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788830491.339148:0:8559:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788830491.339156:0:8559:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788830491.339158:0:8559:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1788830491.339163:0:8559:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1788830491.339972:0:5829:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1788830491.340003:0:5829:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788830491.340014:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: ffff9e2445b7e400/0x575506951eea0b90 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea0b97 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830491.340040:0:5829:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.121@tcp lock: ffff9e2445b7e400/0x575506951eea0b90 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea0b97 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830491.678923:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788830492.700805:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788830493.583617:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830493.583706:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830493.583759:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830493.583789:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830493.583823:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578331264 00000100:00100000:0.0:1788830493.583833:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578331264 00000100:00100000:0.0:1788830493.583901:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578331392 00000100:00100000:0.0:1788830493.583905:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578331392 00000100:00100000:0.0:1788830493.583925:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 14 00000100:00100000:0.0:1788830493.583936:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257fa65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+5:2352:x1875724578331264:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:0.0:1788830493.584012:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257fa65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+5:2352:x1875724578331264:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 78us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830493.584019:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 14 00000100:00100000:0.0:1788830493.584036:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 15 00000100:00100000:0.0:1788830493.584043:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257fa64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+5:2352:x1875724578331392:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:0.0:1788830493.584068:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257fa64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+5:2352:x1875724578331392:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 25us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830493.584074:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 15 00000100:00080000:0.0:1788830493.584090:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788830493.584100:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788830493.585891:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578331136 00000100:00100000:0.0:1788830493.585905:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578331136 00000100:00100000:0.0:1788830493.585977:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 25 00000100:00100000:0.0:1788830493.585987:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257fa67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+6:2352:x1875724578331136:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:0.0:1788830493.586056:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257fa67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+6:2352:x1875724578331136:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 71us (2295us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830493.586063:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 25 00000100:00080000:0.0:1788830493.586091:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788830493.588395:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578331008 00000100:00100000:3.0:1788830493.588412:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578331008 00000100:00100000:3.0:1788830493.588512:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 191 00000100:00100000:3.0:1788830493.588523:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25747bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+10:2352:x1875724578331008:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:3.0:1788830493.588609:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25747bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+10:2352:x1875724578331008:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 88us (5001us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830493.588616:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 191 00010000:00010000:1.0:1788830493.723944:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788830494.438346:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257f724e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875724595137152:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788830494.438427:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830494.441354:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595137152 00000100:00100000:3.0:1788830494.441372:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595137152 00000100:00100000:3.0:1788830494.441465:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788830494.441476:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257fa66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875724595137152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788830494.441524:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788830494.441607:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257fa66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875724595137152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 133us (3180us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830494.441615:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:3.0:1788830494.441665:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e257f724e00 x1875724595137152/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788830510 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788830494.441686:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257f724e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875724595137152:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788830494.441804:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788830494.758398:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788830495.451909:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257fa64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1875724595137664:0@lo:400:kworker.0 00000100:00100000:0.0:1788830495.451990:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830495.452056:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788830495.452063:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257fa64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1745cc3d-3952-4cd4-9020-9b8acb483105:3307:1875724595137280:0@lo:400:kworker.0 00000100:00100000:0.0:1788830495.452095:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830495.452115:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257fa64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1875724595137792:0@lo:400:kworker.0 00000100:00100000:0.0:1788830495.452136:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830495.452165:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257fa65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875724595137408:0@lo:400:kworker.0 00000100:00100000:0.0:1788830495.452189:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830495.452205:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257fa66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875724595137920:0@lo:400:kworker.0 00000100:00100000:0.0:1788830495.452226:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830495.452244:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788830495.452249:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257fa66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875724595137536:0@lo:400:kworker.0 00000100:00100000:0.0:1788830495.452268:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830495.452316:0:8202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595137664 00000100:00100000:0.0:1788830495.452323:0:8202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595137664 00000100:00100000:0.0:1788830495.452369:0:8202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595137792 00000100:00100000:0.0:1788830495.452372:0:8202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595137792 00000100:00100000:0.0:1788830495.452385:0:8202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595137408 00000100:00100000:0.0:1788830495.452387:0:8202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595137408 00000100:00100000:0.0:1788830495.452400:0:8202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788830495.452408:0:8202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257fa67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875724595137664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788830495.452459:0:8202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257fa67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875724595137664:12345-0@lo:400:kworker.0 Request processed in 52us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830495.452466:0:8202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788830495.452481:0:8202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788830495.452488:0:8202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257fa65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875724595137792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788830495.452515:0:8202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257fa65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875724595137792:12345-0@lo:400:kworker.0 Request processed in 28us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830495.452520:0:8202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788830495.452531:0:8202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788830495.452536:0:8202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257fa65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875724595137408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788830495.452563:0:8202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257fa65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875724595137408:12345-0@lo:400:kworker.0 Request processed in 28us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830495.452569:0:8202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788830495.452593:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595137920 00000100:00100000:0.0:1788830495.452596:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595137920 00000100:00100000:0.0:1788830495.452622:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595137536 00000100:00100000:0.0:1788830495.452625:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595137536 00000100:00100000:0.0:1788830495.452637:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788830495.452643:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257fa64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875724595137920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788830495.452672:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257fa64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875724595137920:12345-0@lo:400:kworker.0 Request processed in 29us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830495.452685:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788830495.452698:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788830495.452704:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257fa66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875724595137536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788830495.452755:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257fa66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875724595137536:12345-0@lo:400:kworker.0 Request processed in 51us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830495.452761:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:0.0:1788830495.452805:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e257fa66a00 x1875724595137536/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788830511 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788830495.452829:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257fa66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875724595137536:0@lo:400:kworker.0 00000100:00100000:0.0:1788830495.452844:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257fa65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875724595137408:0@lo:400:kworker.0 00010000:00080000:0.0:1788830495.452853:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e257fa66d80 x1875724595137920/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788830511 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788830495.452862:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257fa66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875724595137920:0@lo:400:kworker.0 00000100:00100000:0.0:1788830495.452893:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257fa64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1875724595137792:0@lo:400:kworker.0 00000100:00100000:0.0:1788830495.452903:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257fa64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1875724595137664:0@lo:400:kworker.0 00000100:00100000:1.0:1788830495.453275:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595137280 00000100:00100000:1.0:1788830495.453282:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595137280 00000100:00100000:1.0:1788830495.453329:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1788830495.453337:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e254812d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+19:3307:x1875724595137280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788830495.453377:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e254812d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+19:3307:x1875724595137280:12345-0@lo:400:kworker.0 Request processed in 41us (1280us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830495.453383:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00080000:1.0:1788830495.453410:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788830495.453414:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788830495.454997:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257fa64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1745cc3d-3952-4cd4-9020-9b8acb483105:3307:1875724595137280:0@lo:400:kworker.0 00010000:00010000:1.0:1788830495.773210:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788830495.964474:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788830495.964502:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e255005e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875724595138048:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788830495.964588:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788830495.964879:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595138048 00000100:00100000:2.0:1788830495.964887:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595138048 00000100:00100000:2.0:1788830495.964935:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788830495.964944:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257f724e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875724595138048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788830495.964982:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788830495.965083:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257f724e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875724595138048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 139us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830495.965090:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:0.0:1788830495.971503:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e255005e300 x1875724595138048/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788830511 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788830495.971533:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e255005e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875724595138048:0@lo:13:osp-pre-1-0.0 00000001:02000400:1.0:1788830496.293044:0:8803:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg121-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:1.0:1788830496.804054:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788830497.820018:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788830498.703306:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830498.703365:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830498.703425:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830498.703464:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830498.703494:0:8202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578331648 00000100:00100000:0.0:1788830498.703505:0:8202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578331648 00000100:00100000:0.0:1788830498.703576:0:8202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 29 00000100:00100000:0.0:1788830498.703587:0:8202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257fa64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+6:2352:x1875724578331648:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:0.0:1788830498.703688:0:8202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257fa64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+6:2352:x1875724578331648:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 103us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830498.703696:0:8202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 29 00000100:00100000:0.0:1788830498.703752:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578331776 00000100:00100000:0.0:1788830498.703756:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578331776 00000100:00100000:0.0:1788830498.703791:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578331904 00000100:00100000:0.0:1788830498.703794:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578331904 00000100:00100000:0.0:1788830498.703813:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 18 00000100:00100000:0.0:1788830498.703819:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257fa64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+5:2352:x1875724578331776:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:0.0:1788830498.703847:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257fa64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+5:2352:x1875724578331776:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 29us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830498.703854:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 18 00000100:00100000:0.0:1788830498.703865:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 19 00000100:00100000:0.0:1788830498.703872:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257fa64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+5:2352:x1875724578331904:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:0.0:1788830498.703893:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257fa64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+5:2352:x1875724578331904:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 22us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830498.703898:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 19 00000100:00080000:0.0:1788830498.703913:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788830498.703917:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788830498.703919:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788830498.704183:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578331520 00000100:00100000:3.0:1788830498.704189:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578331520 00000100:00100000:3.0:1788830498.704301:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 193 00000100:00100000:3.0:1788830498.704310:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e254812d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+10:2352:x1875724578331520:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:3.0:1788830498.704353:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e254812d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+10:2352:x1875724578331520:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 44us (1060us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830498.704360:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 193 00010000:00010000:2.0:1788830498.858917:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788830499.547954:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788830499.547979:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257f725f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875724595138176:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788830499.548047:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830499.549677:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595138176 00000100:00100000:3.0:1788830499.549691:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595138176 00000100:00100000:3.0:1788830499.549800:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788830499.549810:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255005c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875724595138176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788830499.549849:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788830499.549924:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255005c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875724595138176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 115us (1876us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830499.549931:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:3.0:1788830499.549995:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e257f725f80 x1875724595138176/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788830515 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788830499.550014:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257f725f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875724595138176:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788830499.550190:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788830499.877335:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788830500.572191:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257fa65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875724595138432:0@lo:400:kworker.0 00000100:00100000:3.0:1788830500.572203:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257fa66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1745cc3d-3952-4cd4-9020-9b8acb483105:3308:1875724595138304:0@lo:400:kworker.0 00000100:00100000:1.0:1788830500.573930:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257fa65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1875724595138688:0@lo:400:kworker.0 00000100:00100000:3.0:1788830500.579108:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830500.579172:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e244599a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1875724595138816:0@lo:400:kworker.0 00000100:00100000:3.0:1788830500.579213:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830500.579262:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595138304 00000100:00100000:3.0:1788830500.579269:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595138304 00000100:00100000:3.0:1788830500.579314:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1788830500.579323:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e254812f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1745cc3d-3952-4cd4-9020-9b8acb483105+19:3308:x1875724595138304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788830500.579380:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e254812f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1745cc3d-3952-4cd4-9020-9b8acb483105+19:3308:x1875724595138304:12345-0@lo:400:kworker.0 Request processed in 57us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830500.579387:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1788830500.579420:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595138816 00000100:00100000:3.0:1788830500.579424:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595138816 00000100:00100000:3.0:1788830500.579460:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788830500.579467:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257f725f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875724595138816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788830500.579521:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257f725f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875724595138816:12345-0@lo:400:kworker.0 Request processed in 54us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830500.579528:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:3.0:1788830500.579548:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788830500.579574:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257fa66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1745cc3d-3952-4cd4-9020-9b8acb483105:3308:1875724595138304:0@lo:400:kworker.0 00000100:00100000:3.0:1788830500.579589:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e244599a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1875724595138816:0@lo:400:kworker.0 00000100:00100000:2.0:1788830500.582826:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257fa66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875724595138560:0@lo:400:kworker.0 00000100:00100000:2.0:1788830500.582906:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788830500.582978:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595138560 00000100:00100000:2.0:1788830500.582986:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595138560 00000100:00100000:2.0:1788830500.583834:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788830500.583844:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255005e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875724595138560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788830500.583899:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255005e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875724595138560:12345-0@lo:400:kworker.0 Request processed in 57us (992us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830500.583906:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788830500.584047:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830500.584084:0:8202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595138432 00000100:00100000:0.0:1788830500.584088:0:8202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595138432 00000100:00100000:0.0:1788830500.584115:0:8202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788830500.584122:0:8202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2445999f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875724595138432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788830500.584154:0:8202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2445999f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875724595138432:12345-0@lo:400:kworker.0 Request processed in 32us (107us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830500.584160:0:8202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788830500.584199:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257fa65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875724595138432:0@lo:400:kworker.0 00000100:00100000:0.0:1788830500.584209:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2445998e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875724595138944:0@lo:400:kworker.0 00000100:00100000:0.0:1788830500.584234:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830500.584255:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595138944 00000100:00100000:0.0:1788830500.584259:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595138944 00000100:00100000:0.0:1788830500.584291:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788830500.584297:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e244599b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875724595138944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788830500.584330:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e244599b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875724595138944:12345-0@lo:400:kworker.0 Request processed in 34us (96us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830500.584336:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:0.0:1788830500.584351:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788830500.584372:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e2445998e00 x1875724595138944/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788830516 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788830500.584383:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2445998e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875724595138944:0@lo:400:kworker.0 00000100:00100000:1.0:1788830500.584534:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830500.584599:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595138688 00000100:00100000:0.0:1788830500.584611:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595138688 00000100:00100000:0.0:1788830500.584641:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788830500.584647:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25654e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875724595138688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788830500.584677:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25654e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875724595138688:12345-0@lo:400:kworker.0 Request processed in 31us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830500.584683:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:0.0:1788830500.584695:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788830500.586976:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e257fa66a00 x1875724595138560/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788830516 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788830500.586995:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257fa66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875724595138560:0@lo:400:kworker.0 00000100:00100000:1.0:1788830500.588933:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257fa65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1875724595138688:0@lo:400:kworker.0 00010000:00010000:2.0:1788830500.897625:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788830501.084915:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788830501.084946:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2445998e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875724595139072:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788830501.085034:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830501.085235:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595139072 00000100:00100000:0.0:1788830501.085244:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595139072 00000100:00100000:0.0:1788830501.085300:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788830501.085310:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257f727480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875724595139072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788830501.085348:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788830501.085410:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257f727480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875724595139072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830501.085417:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:1.0:1788830501.085458:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e2445998e00 x1875724595139072/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788830517 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788830501.085478:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2445998e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875724595139072:0@lo:13:osp-pre-1-0.0 00000001:02000400:0.0:1788830501.149348:0:9047:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg121-server.virtnet: executing yml_node 00010000:00010000:0.0:1788830501.916904:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788830502.939941:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788830503.820283:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830503.820333:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830503.820506:0:8202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578332160 00000100:00100000:2.0:1788830503.820516:0:8202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578332160 00000100:00100000:2.0:1788830503.820588:0:8202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 33 00000100:00100000:2.0:1788830503.820599:0:8202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257f724a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+6:2355:x1875724578332160:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:2.0:1788830503.820676:0:8202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257f724a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+6:2355:x1875724578332160:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 79us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830503.820698:0:8202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 33 00000100:00100000:1.0:1788830503.821074:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578332032 00000100:00100000:1.0:1788830503.821091:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578332032 00000100:00100000:1.0:1788830503.821133:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 195 00000100:00100000:1.0:1788830503.821141:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255d99b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+10:2355:x1875724578332032:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:1.0:1788830503.821189:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255d99b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+10:2355:x1875724578332032:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 48us (916us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830503.821195:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 195 00000100:00080000:3.0:1788830503.821396:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788830503.843487:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830503.843584:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830503.848657:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578332288 00000100:00100000:0.0:1788830503.848676:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578332288 00000100:00080000:3.0:1788830503.849065:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788830503.849241:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578332416 00000100:00100000:1.0:1788830503.849247:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578332416 00000100:00100000:1.0:1788830503.849302:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 12 00000100:00100000:1.0:1788830503.849313:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255005c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+5:2351:x1875724578332288:12345-192.168.201.21@tcp:9:kworker.0 00000020:00000080:1.0:1788830503.849355:0:6677:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x575506951eea0ad3 00000100:00080000:1.0:1788830503.849366:0:6677:0:(import.c:65:import_set_state_nolock()) ffff9e25475db000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788830503.849408:0:6677:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1788830503.849805:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255005c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+2:2351:x1875724578332288:12345-192.168.201.21@tcp:9:kworker.0 Request processed in 492us (6328us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830503.849814:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 12 00000100:00080000:3.0:1788830503.849950:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788830503.850114:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788830503.850286:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 13 00000100:00100000:2.0:1788830503.850300:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255005f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+5:2351:x1875724578332416:12345-192.168.201.21@tcp:9:kworker.0 00000020:00000080:2.0:1788830503.850325:0:6679:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x575506951eea0ada 00000100:00080000:2.0:1788830503.850348:0:6679:0:(import.c:65:import_set_state_nolock()) ffff9e25475dc800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788830503.850383:0:6679:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1788830503.850658:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255005f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+2:2351:x1875724578332416:12345-192.168.201.21@tcp:9:kworker.0 Request processed in 360us (7071us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830503.850667:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 13 00010000:00010000:3.0:1788830503.850740:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788830503.965118:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788830504.667966:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257f726a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875724595139200:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788830504.668040:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830504.668927:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595139200 00000100:00100000:0.0:1788830504.668938:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595139200 00000100:00100000:0.0:1788830504.669020:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788830504.669033:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25654ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875724595139200:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788830504.669071:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1788830504.669208:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788830504.676537:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25654ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875724595139200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 7496us (8486us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830504.676629:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:1.0:1788830504.679426:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e257f726a00 x1875724595139200/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788830520 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788830504.679454:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257f726a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875724595139200:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788830504.989933:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788830505.242284:0:6709:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 1ef2fe7a-e5ec-4085-8326-b72aa00876cd 00000020:00000080:3.0:1788830505.242293:0:6709:0:(genops.c:885:class_export_put()) final put ffff9e25475da800/1ef2fe7a-e5ec-4085-8326-b72aa00876cd 00000020:00000080:0.0:1788830505.242364:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9e25475da800/1ef2fe7a-e5ec-4085-8326-b72aa00876cd for lustre-OST0000 00000020:00000080:0.0:1788830505.242411:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e25475db000 for lustre-OST0000 00000001:02000400:2.0:1788830505.525521:0:9241:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.104 00000100:00100000:1.0:1788830505.692275:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25654e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1875724595139712:0@lo:400:kworker.0 00000100:00100000:1.0:1788830505.692350:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830505.692404:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788830505.692411:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25654eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1745cc3d-3952-4cd4-9020-9b8acb483105:3307:1875724595139328:0@lo:400:kworker.0 00000100:00100000:1.0:1788830505.692462:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830505.692490:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25654e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1875724595139840:0@lo:400:kworker.0 00000100:00100000:1.0:1788830505.692514:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830505.692540:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25654ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875724595139456:0@lo:400:kworker.0 00000100:00100000:1.0:1788830505.692563:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830505.692579:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25654e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875724595139968:0@lo:400:kworker.0 00000100:00100000:1.0:1788830505.692601:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830505.692623:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788830505.692629:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25654eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875724595139584:0@lo:400:kworker.0 00000100:00100000:1.0:1788830505.692663:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830505.692694:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595139328 00000100:00100000:1.0:1788830505.692702:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595139328 00000100:00100000:1.0:1788830505.692788:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1788830505.692797:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255d99a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1745cc3d-3952-4cd4-9020-9b8acb483105+19:3307:x1875724595139328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788830505.692847:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255d99a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1745cc3d-3952-4cd4-9020-9b8acb483105+19:3307:x1875724595139328:12345-0@lo:400:kworker.0 Request processed in 51us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830505.692854:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1788830505.692886:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595139968 00000100:00100000:1.0:1788830505.692889:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595139968 00000100:00100000:1.0:1788830505.692922:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595139584 00000100:00100000:1.0:1788830505.692925:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595139584 00000100:00100000:1.0:1788830505.692940:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788830505.692945:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25654e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875724595139968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788830505.692983:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25654e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875724595139968:12345-0@lo:400:kworker.0 Request processed in 37us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830505.692988:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788830505.693013:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788830505.693019:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25654ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875724595139584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788830505.693048:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25654ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875724595139584:12345-0@lo:400:kworker.0 Request processed in 29us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830505.693054:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:1.0:1788830505.693291:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788830505.693322:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e25654eb800 x1875724595139584/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788830521 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788830505.693335:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25654eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875724595139584:0@lo:400:kworker.0 00010000:00080000:1.0:1788830505.693346:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e25654e9180 x1875724595139968/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788830521 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788830505.693354:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25654e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875724595139968:0@lo:400:kworker.0 00000100:00100000:1.0:1788830505.693384:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25654eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1745cc3d-3952-4cd4-9020-9b8acb483105:3307:1875724595139328:0@lo:400:kworker.0 00000100:00100000:2.0:1788830505.693509:0:8202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595139712 00000100:00100000:2.0:1788830505.693513:0:8202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595139712 00000100:00100000:2.0:1788830505.693565:0:8202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595139840 00000100:00100000:2.0:1788830505.693569:0:8202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595139840 00000100:00100000:2.0:1788830505.693583:0:8202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595139456 00000100:00100000:2.0:1788830505.693585:0:8202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595139456 00000100:00100000:2.0:1788830505.693597:0:8202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788830505.693604:0:8202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25654eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875724595139712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788830505.693656:0:8202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25654eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875724595139712:12345-0@lo:400:kworker.0 Request processed in 42us (1296us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830505.693662:0:8202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788830505.693678:0:8202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788830505.693683:0:8202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25654e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875724595139840:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788830505.693832:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788830505.693874:0:8202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25654e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875724595139840:12345-0@lo:400:kworker.0 Request processed in 190us (1358us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830505.693880:0:8202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788830505.693893:0:8202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788830505.693900:0:8202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25654ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875724595139456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788830505.693942:0:8202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25654ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875724595139456:12345-0@lo:400:kworker.0 Request processed in 43us (1378us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830505.693948:0:8202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788830505.693992:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25654e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1875724595139840:0@lo:400:kworker.0 00000100:00100000:2.0:1788830505.694004:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25654e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1875724595139712:0@lo:400:kworker.0 00000100:00100000:1.0:1788830505.694064:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25654ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875724595139456:0@lo:400:kworker.0 00010000:00010000:3.0:1788830506.012883:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788830506.204780:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25654ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875724595140096:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788830506.204859:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830506.204900:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595140096 00000100:00100000:3.0:1788830506.204909:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595140096 00000100:00100000:3.0:1788830506.204958:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788830506.204967:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25654eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875724595140096:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788830506.205001:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788830506.205058:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25654eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875724595140096:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830506.205065:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:1.0:1788830506.205133:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e25654ead80 x1875724595140096/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788830522 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788830506.205151:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25654ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875724595140096:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788830507.035855:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788830507.878682:0:9338:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.104 00010000:00010000:3.0:1788830508.060018:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788830508.373797:0:7646:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 1ef2fe7a-e5ec-4085-8326-b72aa00876cd 00000020:00000080:0.0:1788830508.373807:0:7646:0:(genops.c:885:class_export_put()) final put ffff9e25475dd000/1ef2fe7a-e5ec-4085-8326-b72aa00876cd 00000020:00000080:1.0:1788830508.373953:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e25475dd000/1ef2fe7a-e5ec-4085-8326-b72aa00876cd for lustre-OST0001 00000020:00000080:1.0:1788830508.374012:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e25475dc800 for lustre-OST0001 00000100:00100000:2.0:1788830508.934125:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830508.934175:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830508.934299:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578332544 00000100:00100000:0.0:1788830508.934315:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578332544 00000100:00100000:0.0:1788830508.934376:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 197 00000100:00100000:0.0:1788830508.934389:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255d999450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+10:2352:x1875724578332544:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:0.0:1788830508.934464:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255d999450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+10:2352:x1875724578332544:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 77us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830508.934482:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 197 00000100:00100000:3.0:1788830508.935837:0:8202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578332672 00000100:00100000:3.0:1788830508.935848:0:8202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578332672 00000100:00100000:3.0:1788830508.936132:0:8202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 37 00000100:00100000:3.0:1788830508.936143:0:8202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255005df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+6:2352:x1875724578332672:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:3.0:1788830508.936214:0:8202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255005df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+6:2352:x1875724578332672:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 73us (2038us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830508.936222:0:8202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 37 00000100:00080000:0.0:1788830508.939217:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788830509.087519:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788830509.788877:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788830509.788902:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257f726a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875724595140224:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788830509.788975:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830509.789233:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595140224 00000100:00100000:3.0:1788830509.789243:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595140224 00000100:00100000:3.0:1788830509.789318:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788830509.789330:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2445998a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875724595140224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788830509.789370:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788830509.789424:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2445998a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875724595140224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830509.789430:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:3.0:1788830509.789483:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e257f726a00 x1875724595140224/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788830525 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788830509.789505:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257f726a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875724595140224:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788830509.790252:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788830510.107982:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788830510.819279:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257f726a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1745cc3d-3952-4cd4-9020-9b8acb483105:3308:1875724595140352:0@lo:400:kworker.0 00000100:00100000:1.0:1788830510.819367:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830510.819422:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257f727800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1875724595140864:0@lo:400:kworker.0 00000100:00100000:1.0:1788830510.819451:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830510.819480:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788830510.819487:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257f725180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1875724595140736:0@lo:400:kworker.0 00000100:00100000:1.0:1788830510.819509:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830510.819535:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257f726680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875724595140480:0@lo:400:kworker.0 00000100:00100000:1.0:1788830510.819556:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830510.819586:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257f726d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875724595140992:0@lo:400:kworker.0 00000100:00100000:1.0:1788830510.819611:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830510.819638:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788830510.819645:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257f727100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875724595140608:0@lo:400:kworker.0 00000100:00100000:1.0:1788830510.819666:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830510.819700:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595140864 00000100:00100000:1.0:1788830510.819730:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595140864 00000100:00100000:1.0:1788830510.819795:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595140736 00000100:00100000:1.0:1788830510.819799:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595140736 00000100:00100000:1.0:1788830510.819814:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595140480 00000100:00100000:1.0:1788830510.819816:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595140480 00000100:00100000:1.0:1788830510.819829:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788830510.819837:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25654ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875724595140864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788830510.819890:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25654ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875724595140864:12345-0@lo:400:kworker.0 Request processed in 53us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830510.819897:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788830510.819913:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788830510.819919:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25654e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875724595140736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788830510.819962:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25654e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875724595140736:12345-0@lo:400:kworker.0 Request processed in 42us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830510.819967:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788830510.819978:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788830510.819983:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25654eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875724595140480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788830510.820011:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25654eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875724595140480:12345-0@lo:400:kworker.0 Request processed in 28us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830510.820016:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788830510.820036:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595140992 00000100:00100000:1.0:1788830510.820039:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595140992 00000100:00100000:1.0:1788830510.820062:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595140608 00000100:00100000:1.0:1788830510.820065:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595140608 00000100:00100000:1.0:1788830510.820076:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788830510.820081:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25654e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875724595140992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788830510.820107:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25654e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875724595140992:12345-0@lo:400:kworker.0 Request processed in 27us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830510.820112:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788830510.820121:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788830510.820125:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25654e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875724595140608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788830510.820144:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25654e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875724595140608:12345-0@lo:400:kworker.0 Request processed in 19us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830510.820150:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:1.0:1788830510.820167:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788830510.820172:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788830510.820201:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e257f727100 x1875724595140608/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788830526 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788830510.820228:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257f727100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875724595140608:0@lo:400:kworker.0 00000100:00100000:1.0:1788830510.820240:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257f726680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875724595140480:0@lo:400:kworker.0 00010000:00080000:1.0:1788830510.820248:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e257f726d80 x1875724595140992/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788830526 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788830510.820254:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257f726d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875724595140992:0@lo:400:kworker.0 00000100:00100000:1.0:1788830510.820286:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257f725180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1875724595140736:0@lo:400:kworker.0 00000100:00100000:1.0:1788830510.820294:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257f727800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1875724595140864:0@lo:400:kworker.0 00000100:00100000:3.0:1788830510.820837:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595140352 00000100:00100000:3.0:1788830510.820845:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595140352 00000100:00100000:3.0:1788830510.820889:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1788830510.820898:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255d99bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1745cc3d-3952-4cd4-9020-9b8acb483105+19:3308:x1875724595140352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788830510.820949:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255d99bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1745cc3d-3952-4cd4-9020-9b8acb483105+19:3308:x1875724595140352:12345-0@lo:400:kworker.0 Request processed in 53us (1583us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830510.820955:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1788830510.821989:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257f726a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1745cc3d-3952-4cd4-9020-9b8acb483105:3308:1875724595140352:0@lo:400:kworker.0 00000001:02000400:2.0:1788830511.010004:0:9437:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.104 00010000:00010000:2.0:1788830511.134355:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788830511.324238:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788830511.324264:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25654e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875724595141120:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788830511.324337:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830511.325843:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595141120 00000100:00100000:0.0:1788830511.325857:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595141120 00000100:00100000:0.0:1788830511.325929:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788830511.325940:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257f725880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875724595141120:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788830511.325982:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788830511.326068:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257f725880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875724595141120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 130us (1730us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830511.326075:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:3.0:1788830511.326170:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e25654e9500 x1875724595141120/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788830527 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788830511.326192:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25654e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875724595141120:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788830512.155875:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788830512.628257:0:9486:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Mon Sep 7 21:21:50 EDT 2026 00010000:00010000:2.0:1788830513.180348:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788830514.055523:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830514.055588:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830514.055624:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578332928 00000100:00100000:3.0:1788830514.055633:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578332928 00000100:00100000:3.0:1788830514.055701:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 41 00000100:00100000:3.0:1788830514.055741:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257f724700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+6:2355:x1875724578332928:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:3.0:1788830514.055818:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257f724700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+6:2355:x1875724578332928:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 107us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830514.055826:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 41 00000100:00080000:3.0:1788830514.055848:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788830514.056053:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578332800 00000100:00100000:1.0:1788830514.056058:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578332800 00000100:00100000:1.0:1788830514.056093:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 199 00000100:00100000:1.0:1788830514.056100:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255d999050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+10:2355:x1875724578332800:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:1.0:1788830514.056137:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255d999050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+10:2355:x1875724578332800:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 37us (635us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830514.056144:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 199 00010000:00010000:0.0:1788830514.205045:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788830514.907900:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257f726a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875724595141248:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788830514.907977:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830514.908064:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595141248 00000100:00100000:3.0:1788830514.908072:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595141248 00000100:00100000:3.0:1788830514.908125:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788830514.908135:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257f727800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875724595141248:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788830514.908168:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788830514.908210:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257f727800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875724595141248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830514.908216:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:3.0:1788830514.908235:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788830514.908260:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e257f726a00 x1875724595141248/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788830530 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788830514.908286:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257f726a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875724595141248:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788830515.230317:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788830515.932091:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e255005d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875724595141632:0@lo:400:kworker.0 00000100:00100000:2.0:1788830515.932175:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788830515.932239:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788830515.932246:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e255005e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875724595141504:0@lo:400:kworker.0 00000100:00100000:2.0:1788830515.932271:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788830515.932289:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25478b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875724595142016:0@lo:400:kworker.0 00000100:00100000:2.0:1788830515.932327:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788830515.932367:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595141632 00000100:00100000:2.0:1788830515.932375:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595141632 00000100:00100000:2.0:1788830515.932420:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595142016 00000100:00100000:2.0:1788830515.932423:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595142016 00000100:00100000:2.0:1788830515.932452:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788830515.932460:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25478b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875724595141632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788830515.932523:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25478b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875724595141632:12345-0@lo:400:kworker.0 Request processed in 63us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830515.932530:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788830515.932549:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788830515.932555:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25478b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875724595142016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788830515.932592:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25478b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875724595142016:12345-0@lo:400:kworker.0 Request processed in 37us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830515.932598:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788830515.932617:0:8202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595141504 00000100:00100000:2.0:1788830515.932621:0:8202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595141504 00000100:00100000:2.0:1788830515.932644:0:8202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788830515.932651:0:8202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25478b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875724595141504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788830515.932680:0:8202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25478b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875724595141504:12345-0@lo:400:kworker.0 Request processed in 30us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830515.932685:0:8202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:2.0:1788830515.932706:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788830515.932767:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e255005e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875724595141504:0@lo:400:kworker.0 00010000:00080000:2.0:1788830515.932780:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e25478b5180 x1875724595142016/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788830531 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788830515.932790:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25478b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875724595142016:0@lo:400:kworker.0 00010000:00080000:2.0:1788830515.932799:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e255005d500 x1875724595141632/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788830531 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788830515.932808:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e255005d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875724595141632:0@lo:400:kworker.0 00000100:00100000:0.0:1788830515.933613:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e255005dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1875724595141760:0@lo:400:kworker.0 00000100:00100000:0.0:1788830515.933666:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830515.933706:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788830515.933739:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e255005ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1745cc3d-3952-4cd4-9020-9b8acb483105:3307:1875724595141376:0@lo:400:kworker.0 00000100:00100000:0.0:1788830515.933767:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830515.933792:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e255005fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1875724595141888:0@lo:400:kworker.0 00000100:00100000:0.0:1788830515.933814:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830515.933904:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595141760 00000100:00100000:3.0:1788830515.933910:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595141760 00000100:00100000:3.0:1788830515.933954:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595141888 00000100:00100000:3.0:1788830515.933958:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595141888 00000100:00100000:3.0:1788830515.933973:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788830515.933981:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e244599aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875724595141760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788830515.934027:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e244599aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875724595141760:12345-0@lo:400:kworker.0 Request processed in 46us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830515.934033:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788830515.934048:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788830515.934054:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e244599ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875724595141888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788830515.934080:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e244599ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875724595141888:12345-0@lo:400:kworker.0 Request processed in 26us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830515.934085:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788830515.934117:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e255005fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1875724595141888:0@lo:400:kworker.0 00000100:00100000:3.0:1788830515.934126:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e255005dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1875724595141760:0@lo:400:kworker.0 00000100:00080000:0.0:1788830515.934318:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788830515.934446:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595141376 00000100:00100000:2.0:1788830515.934451:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595141376 00000100:00100000:2.0:1788830515.934496:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1788830515.934503:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255d99b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+19:3307:x1875724595141376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788830515.934547:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255d99b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+19:3307:x1875724595141376:12345-0@lo:400:kworker.0 Request processed in 46us (780us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830515.934553:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1788830515.934648:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e255005ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1745cc3d-3952-4cd4-9020-9b8acb483105:3307:1875724595141376:0@lo:400:kworker.0 00010000:00010000:0.0:1788830516.252452:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788830516.445022:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788830516.445063:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25654e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875724595142144:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788830516.445141:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830516.445218:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595142144 00000100:00100000:1.0:1788830516.445226:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595142144 00000100:00100000:1.0:1788830516.445274:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788830516.445283:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25654e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875724595142144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788830516.445333:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788830516.445375:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25654e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875724595142144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830516.445381:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:1.0:1788830516.445421:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e25654e9c00 x1875724595142144/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788830532 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788830516.445439:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25654e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875724595142144:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788830517.279082:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788830518.299798:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788830519.179165:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830519.179201:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830519.179233:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578333056 00000100:00100000:3.0:1788830519.179243:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578333056 00000100:00100000:3.0:1788830519.179318:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 201 00000100:00100000:3.0:1788830519.179330:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255d998850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+10:2355:x1875724578333056:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:3.0:1788830519.179409:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255d998850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+10:2355:x1875724578333056:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 81us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830519.179429:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 201 00000100:00100000:3.0:1788830519.179461:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578333184 00000100:00100000:3.0:1788830519.179465:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578333184 00000100:00100000:3.0:1788830519.179703:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 45 00000100:00100000:3.0:1788830519.179735:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257f726a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+6:2355:x1875724578333184:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:3.0:1788830519.179770:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257f726a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+6:2355:x1875724578333184:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 60us (569us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830519.179777:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 45 00000100:00080000:0.0:1788830519.189757:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788830519.324080:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788830520.031907:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788830520.031931:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257f725180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875724595142272:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788830520.031999:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830520.032103:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595142272 00000100:00100000:3.0:1788830520.032113:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595142272 00000100:00100000:3.0:1788830520.032182:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788830520.032191:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25654e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875724595142272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788830520.032226:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788830520.032274:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25654e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875724595142272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830520.032293:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:3.0:1788830520.032334:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e257f725180 x1875724595142272/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788830536 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788830520.032353:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257f725180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875724595142272:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788830520.032468:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788830520.349208:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788830521.053457:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2445999880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875724595142656:0@lo:400:kworker.0 00000100:00100000:0.0:1788830521.053641:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830521.053705:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788830521.053738:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2445998700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875724595142528:0@lo:400:kworker.0 00000100:00100000:0.0:1788830521.053897:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830521.053920:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2445998380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875724595143040:0@lo:400:kworker.0 00000100:00100000:0.0:1788830521.053946:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830521.053992:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595142656 00000100:00100000:0.0:1788830521.054001:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595142656 00000100:00100000:0.0:1788830521.054039:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595143040 00000100:00100000:0.0:1788830521.054041:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595143040 00000100:00100000:0.0:1788830521.054065:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788830521.054073:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e244599a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875724595142656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788830521.054123:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e244599a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875724595142656:12345-0@lo:400:kworker.0 Request processed in 51us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830521.054131:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788830521.054146:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788830521.054153:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e244599bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875724595143040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788830521.054194:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e244599bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875724595143040:12345-0@lo:400:kworker.0 Request processed in 42us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830521.054200:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788830521.054219:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595142528 00000100:00100000:0.0:1788830521.054222:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595142528 00000100:00100000:0.0:1788830521.054251:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788830521.054259:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2445998000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875724595142528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788830521.054286:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2445998000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875724595142528:12345-0@lo:400:kworker.0 Request processed in 29us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830521.054292:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788830521.054331:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2445998700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875724595142528:0@lo:400:kworker.0 00010000:00080000:0.0:1788830521.054344:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e2445998380 x1875724595143040/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788830537 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788830521.054355:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2445998380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875724595143040:0@lo:400:kworker.0 00010000:00080000:0.0:1788830521.054364:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e2445999880 x1875724595142656/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788830537 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788830521.054372:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2445999880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875724595142656:0@lo:400:kworker.0 00000100:00100000:3.0:1788830521.055122:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e244599b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1745cc3d-3952-4cd4-9020-9b8acb483105:3308:1875724595142400:0@lo:400:kworker.0 00000100:00100000:3.0:1788830521.055165:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830521.055209:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e244599b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1875724595142912:0@lo:400:kworker.0 00000100:00100000:3.0:1788830521.055234:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830521.055254:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788830521.055260:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2445999180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1875724595142784:0@lo:400:kworker.0 00000100:00100000:3.0:1788830521.055283:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830521.055307:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595142912 00000100:00100000:3.0:1788830521.055311:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595142912 00000100:00100000:3.0:1788830521.055338:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595142784 00000100:00100000:3.0:1788830521.055340:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595142784 00000100:00100000:3.0:1788830521.055359:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788830521.055366:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257f725180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875724595142912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788830521.055415:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257f725180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875724595142912:12345-0@lo:400:kworker.0 Request processed in 50us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830521.055422:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788830521.055446:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788830521.055453:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257f726d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875724595142784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788830521.055851:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595142400 00000100:00100000:0.0:1788830521.055857:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595142400 00000100:00100000:0.0:1788830521.055888:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1788830521.055896:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255d998050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1745cc3d-3952-4cd4-9020-9b8acb483105+19:3308:x1875724595142400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788830521.055933:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255d998050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1745cc3d-3952-4cd4-9020-9b8acb483105+19:3308:x1875724595142400:12345-0@lo:400:kworker.0 Request processed in 39us (769us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830521.055940:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00080000:1.0:1788830521.056062:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788830521.056067:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788830521.056128:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257f726d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875724595142784:12345-0@lo:400:kworker.0 Request processed in 674us (843us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830521.056135:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788830521.056170:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2445999180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1875724595142784:0@lo:400:kworker.0 00000100:00100000:3.0:1788830521.056180:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e244599b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1745cc3d-3952-4cd4-9020-9b8acb483105:3308:1875724595142400:0@lo:400:kworker.0 00000100:00100000:3.0:1788830521.056189:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e244599b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1875724595142912:0@lo:400:kworker.0 00010000:00010000:1.0:1788830521.371978:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788830521.563986:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788830521.564013:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25472fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875724595143168:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788830521.564099:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830521.564283:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595143168 00000100:00100000:1.0:1788830521.564292:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595143168 00000100:00100000:1.0:1788830521.564350:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788830521.564360:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257f726680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875724595143168:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788830521.564408:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788830521.564456:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257f726680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875724595143168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830521.564463:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:1.0:1788830521.564501:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e25472fc380 x1875724595143168/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788830537 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788830521.564517:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25472fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875724595143168:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788830522.402524:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788830523.421826:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788830524.293662:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830524.293779:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830524.293817:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578333312 00000100:00100000:0.0:1788830524.293830:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578333312 00000100:00100000:0.0:1788830524.293895:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 203 00000100:00100000:0.0:1788830524.293907:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255d999c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+10:2355:x1875724578333312:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:0.0:1788830524.294002:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255d999c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+10:2355:x1875724578333312:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 97us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830524.294011:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 203 00000100:00100000:3.0:1788830524.294261:0:8202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578333440 00000100:00100000:3.0:1788830524.294267:0:8202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578333440 00000100:00100000:3.0:1788830524.294323:0:8202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 49 00000100:00100000:3.0:1788830524.294342:0:8202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2445999880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+6:2354:x1875724578333440:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:3.0:1788830524.294387:0:8202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2445999880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+6:2354:x1875724578333440:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 58us (742us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830524.294395:0:8202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 49 00000100:00080000:0.0:1788830524.295229:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788830524.444000:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788830525.148668:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257f727100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875724595143296:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788830525.148839:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830525.149289:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595143296 00000100:00100000:3.0:1788830525.149302:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595143296 00000100:00100000:3.0:1788830525.149498:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788830525.149512:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25472fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875724595143296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788830525.149564:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788830525.149633:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25472fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875724595143296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 123us (794us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830525.149641:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:3.0:1788830525.149695:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e257f727100 x1875724595143296/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788830541 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788830525.149745:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257f727100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875724595143296:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788830525.153330:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788830525.474140:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788830526.176800:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257fa66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875724595143680:0@lo:400:kworker.0 00000100:00100000:3.0:1788830526.176906:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830526.177001:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788830526.177009:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257fa65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875724595143552:0@lo:400:kworker.0 00000100:00100000:3.0:1788830526.177075:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830526.177100:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2566012680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875724595144064:0@lo:400:kworker.0 00000100:00100000:3.0:1788830526.177127:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830526.177317:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595143680 00000100:00100000:0.0:1788830526.177328:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595143680 00000100:00100000:0.0:1788830526.177389:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595144064 00000100:00100000:0.0:1788830526.177392:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595144064 00000100:00100000:0.0:1788830526.177426:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788830526.177439:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2566011500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875724595143680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788830526.177516:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2566011500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875724595143680:12345-0@lo:400:kworker.0 Request processed in 78us (609us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830526.177524:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788830526.177543:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788830526.177550:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2545cbe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875724595144064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788830526.177582:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2545cbe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875724595144064:12345-0@lo:400:kworker.0 Request processed in 32us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830526.177588:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788830526.177623:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257f727100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1745cc3d-3952-4cd4-9020-9b8acb483105:3308:1875724595143424:0@lo:400:kworker.0 00000100:00100000:0.0:1788830526.177671:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830526.177696:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257fa66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1875724595143936:0@lo:400:kworker.0 00000100:00100000:0.0:1788830526.177743:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830526.177811:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257fa65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1875724595143808:0@lo:400:kworker.0 00000100:00080000:1.0:1788830526.177871:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788830526.177904:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e2566012680 x1875724595144064/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788830542 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788830526.177920:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2566012680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875724595144064:0@lo:400:kworker.0 00010000:00080000:1.0:1788830526.177932:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e257fa66a00 x1875724595143680/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788830542 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788830526.177942:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257fa66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875724595143680:0@lo:400:kworker.0 00000100:00100000:1.0:1788830526.177982:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595143424 00000100:00100000:1.0:1788830526.177986:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595143424 00000100:00100000:1.0:1788830526.178022:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1788830526.178029:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255d99a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1745cc3d-3952-4cd4-9020-9b8acb483105+19:3308:x1875724595143424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788830526.178063:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255d99a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1745cc3d-3952-4cd4-9020-9b8acb483105+19:3308:x1875724595143424:12345-0@lo:400:kworker.0 Request processed in 35us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830526.178069:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1788830526.181137:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257f727100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1745cc3d-3952-4cd4-9020-9b8acb483105:3308:1875724595143424:0@lo:400:kworker.0 00000100:00100000:1.0:1788830526.181890:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830526.183182:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595143552 00000100:00100000:3.0:1788830526.183203:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595143552 00000100:00100000:3.0:1788830526.183284:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595143936 00000100:00100000:3.0:1788830526.183287:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595143936 00000100:00100000:3.0:1788830526.183324:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595143808 00000100:00100000:3.0:1788830526.183327:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595143808 00000100:00100000:3.0:1788830526.183349:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788830526.183359:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2545cbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875724595143552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788830526.183490:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2545cbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875724595143552:12345-0@lo:400:kworker.0 Request processed in 131us (6413us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830526.183498:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788830526.183518:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788830526.183524:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2445998380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875724595143936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788830526.183561:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2445998380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875724595143936:12345-0@lo:400:kworker.0 Request processed in 38us (5818us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830526.183567:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788830526.183579:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788830526.183585:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25472fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875724595143808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788830526.183624:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25472fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875724595143808:12345-0@lo:400:kworker.0 Request processed in 40us (1739us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830526.183629:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788830526.183692:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257fa65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1875724595143808:0@lo:400:kworker.0 00000100:00100000:3.0:1788830526.183771:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257fa65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875724595143552:0@lo:400:kworker.0 00000100:00080000:1.0:1788830526.185334:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788830526.187028:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257fa66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1875724595143936:0@lo:400:kworker.0 00010000:00010000:0.0:1788830526.492076:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788830526.685575:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788830526.685608:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2545cbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875724595144192:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788830526.685704:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830526.685834:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595144192 00000100:00100000:3.0:1788830526.685846:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595144192 00000100:00100000:3.0:1788830526.685910:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788830526.685922:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2545cbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875724595144192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788830526.688746:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788830526.688903:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2545cbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875724595144192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2977us (3192us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830526.688918:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:1.0:1788830526.691611:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e2545cbce00 x1875724595144192/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788830542 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788830526.691650:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2545cbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875724595144192:0@lo:13:osp-pre-1-0.0 00000001:02000400:3.0:1788830527.282537:0:10117:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 21:22:05 (1788830525) === 00010000:00010000:2.0:1788830527.525381:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788830527.695981:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830527.696209:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578333568 00000100:00100000:2.0:1788830527.696224:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578333568 00000100:00100000:2.0:1788830527.696312:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 205 00000100:00100000:2.0:1788830527.696325:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255d998450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+10:8122:x1875724578333568:12345-192.168.201.21@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788830527.696348:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788830527.696375:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2565728800/0x575506951eea0b9e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xa578910534661c03 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830527.696418:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2565728800/0x575506951eea0b9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661c03 expref: 11 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830527.696432:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2565728800/0x575506951eea0b9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661c03 expref: 11 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830527.696444:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2565728800, rc 0) 00000100:00100000:2.0:1788830527.696656:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255d998450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+11:8122:x1875724578333568:12345-192.168.201.21@tcp:101:mount.lustre.0 Request processed in 333us (691us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830527.696665:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 205 00000100:00100000:3.0:1788830527.703332:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830527.705776:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578333696 00000100:00100000:1.0:1788830527.705824:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578333696 00000100:00100000:2.0:1788830527.707281:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 206 00000100:00100000:2.0:1788830527.707299:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255d99b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+11:8122:x1875724578333696:12345-192.168.201.21@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788830527.707828:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255d99b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+11:8122:x1875724578333696:12345-192.168.201.21@tcp:501:mount.lustre.0 Request processed in 531us (4511us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830527.707837:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 206 00000100:00100000:0.0:1788830527.716765:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830527.722021:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578333824 00000100:00100000:2.0:1788830527.722045:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578333824 00000100:00100000:2.0:1788830527.722159:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 207 00000100:00100000:2.0:1788830527.722171:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255d99ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+11:8122:x1875724578333824:12345-192.168.201.21@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788830527.722519:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255d99ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+11:8122:x1875724578333824:12345-192.168.201.21@tcp:503:mount.lustre.0 Request processed in 349us (5811us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830527.722528:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 207 00000100:00100000:0.0:1788830527.726325:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830527.726512:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578333952 00000100:00100000:2.0:1788830527.726526:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578333952 00000100:00100000:2.0:1788830527.726599:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 208 00000100:00100000:2.0:1788830527.726611:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255d998c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+11:8126:x1875724578333952:12345-192.168.201.21@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788830527.728785:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255d998c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+11:8126:x1875724578333952:12345-192.168.201.21@tcp:502:llog_process_th.0 Request processed in 2160us (2463us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830527.728803:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 208 00000100:00100000:0.0:1788830527.760315:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830527.760431:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578334080 00000100:00100000:1.0:1788830527.760445:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578334080 00000100:00100000:1.0:1788830527.760529:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 209 00000100:00100000:1.0:1788830527.760543:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255d99a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+11:8126:x1875724578334080:12345-192.168.201.21@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788830527.760954:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255d99a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+11:8126:x1875724578334080:12345-192.168.201.21@tcp:502:llog_process_th.0 Request processed in 413us (654us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830527.760965:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 209 00000100:00100000:0.0:1788830527.767838:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830527.769693:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578334208 00000100:00100000:1.0:1788830527.769758:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578334208 00000100:00100000:1.0:1788830527.769849:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 210 00000100:00100000:1.0:1788830527.769862:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255d999850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+11:8122:x1875724578334208:12345-192.168.201.21@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788830527.769885:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788830527.769909:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e25820fee00/0x575506951eea0ba5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa578910534661c2d expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830527.769950:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e25820fee00/0x575506951eea0ba5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661c2d expref: 12 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830527.769963:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e25820fee00/0x575506951eea0ba5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661c2d expref: 12 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830527.769975:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e25820fee00, rc 0) 00000100:00100000:1.0:1788830527.771820:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255d999850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+12:8122:x1875724578334208:12345-192.168.201.21@tcp:101:mount.lustre.0 Request processed in 1947us (3983us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830527.771859:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 210 00000100:00100000:3.0:1788830527.778052:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830527.778191:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578334336 00000100:00100000:0.0:1788830527.778206:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578334336 00000100:00100000:0.0:1788830527.778310:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 211 00000100:00100000:0.0:1788830527.778323:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2574712850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+12:8122:x1875724578334336:12345-192.168.201.21@tcp:256:mount.lustre.0 20000000:01000000:0.0:1788830527.778362:0:5827:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788830527.778400:0:5827:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788830527.778405:0:5827:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788830527.778408:0:5827:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788830527.778411:0:5827:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:2.0:1788830527.780853:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2574712850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+12:8122:x1875724578334336:12345-192.168.201.21@tcp:256:mount.lustre.0 Request processed in 2515us (2801us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830527.780871:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 211 00000100:00100000:3.0:1788830527.790083:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830527.790260:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578334464 00000100:00100000:1.0:1788830527.790288:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578334464 00000100:00100000:1.0:1788830527.790372:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 212 00000100:00100000:1.0:1788830527.790385:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2574713c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+12:8122:x1875724578334464:12345-192.168.201.21@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788830527.790420:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788830527.790446:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e25820ffa00/0x575506951eea0bac lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa578910534661c34 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830527.790483:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e25820ffa00/0x575506951eea0bac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661c34 expref: 13 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830527.790497:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e25820ffa00/0x575506951eea0bac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661c34 expref: 13 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830527.790687:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e25820ffa00, rc 0) 00000100:00100000:1.0:1788830527.790814:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2574713c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+13:8122:x1875724578334464:12345-192.168.201.21@tcp:101:mount.lustre.0 Request processed in 430us (744us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830527.790822:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 212 00000100:00100000:3.0:1788830527.792930:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830527.793260:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578334592 00000100:00100000:2.0:1788830527.793283:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578334592 00000100:00100000:2.0:1788830527.793355:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 213 00000100:00100000:2.0:1788830527.793368:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2574711050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+13:8122:x1875724578334592:12345-192.168.201.21@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788830527.793963:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2574711050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+13:8122:x1875724578334592:12345-192.168.201.21@tcp:501:mount.lustre.0 Request processed in 595us (1042us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830527.793973:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 213 00000100:00100000:2.0:1788830527.797088:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830527.798080:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578334720 00000100:00100000:0.0:1788830527.798096:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578334720 00000100:00100000:0.0:1788830527.798292:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 214 00000100:00100000:0.0:1788830527.798306:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2574713850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+13:8122:x1875724578334720:12345-192.168.201.21@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788830527.798648:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2574713850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+13:8122:x1875724578334720:12345-192.168.201.21@tcp:503:mount.lustre.0 Request processed in 344us (1575us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830527.798668:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 214 00000100:00100000:3.0:1788830527.802390:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830527.804139:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578334848 00000100:00100000:1.0:1788830527.804161:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578334848 00000100:00100000:1.0:1788830527.805400:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 215 00000100:00100000:1.0:1788830527.805425:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2574711c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+13:8130:x1875724578334848:12345-192.168.201.21@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788830527.807205:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2574711c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+13:8130:x1875724578334848:12345-192.168.201.21@tcp:502:llog_process_th.0 Request processed in 1773us (4814us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830527.807224:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 215 00000100:00100000:3.0:1788830527.810892:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830527.811316:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578334976 00000100:00100000:0.0:1788830527.811333:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578334976 00000100:00100000:0.0:1788830527.811614:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 216 00000100:00100000:0.0:1788830527.811629:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2574712450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+13:8130:x1875724578334976:12345-192.168.201.21@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788830527.812056:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2574712450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+13:8130:x1875724578334976:12345-192.168.201.21@tcp:502:llog_process_th.0 Request processed in 428us (1177us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830527.812066:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 216 00000100:00100000:0.0:1788830527.818167:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830527.818363:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578335232 00000100:00100000:3.0:1788830527.818380:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578335232 00000100:00100000:3.0:1788830527.818555:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 53 00000100:00100000:3.0:1788830527.818568:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2445998700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+6:2352:x1875724578335232:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:3.0:1788830527.819033:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2445998700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+6:2352:x1875724578335232:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 466us (883us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830527.819042:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 53 00000100:00100000:0.0:1788830527.819146:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830527.820752:0:8202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578335104 00000100:00100000:3.0:1788830527.820774:0:8202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578335104 00000100:00100000:3.0:1788830527.820858:0:8202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 10 00000100:00100000:3.0:1788830527.820870:0:8202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2445999c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2351:x1875724578335104:12345-192.168.201.21@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788830527.820912:0:8202:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from c2154ea6-69cb-4a30-aac0-000fba13e98b@192.168.201.21@tcp t0 exp 0000000000000000 cur 281 last 0 00000020:00000080:3.0:1788830527.820977:0:8202:0:(genops.c:1385:class_connect()) connect: client c2154ea6-69cb-4a30-aac0-000fba13e98b, cookie 0x575506951eea0bb3 00000004:00100000:3.0:1788830527.821018:0:8202:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1788830527.821384:0:8202:0:(import.c:65:import_set_state_nolock()) ffff9e257fc9b800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788830527.821480:0:8202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2445999c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2154ea6-69cb-4a30-aac0-000fba13e98b+6:2351:x1875724578335104:12345-192.168.201.21@tcp:38:mount.lustre.0 Request processed in 609us (2332us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830527.821489:0:8202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 10 00000100:00080000:1.0:1788830527.823618:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788830527.836047:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830527.836526:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578335360 00000100:00100000:1.0:1788830527.836544:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578335360 00000100:00080000:2.0:1788830527.836641:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788830527.836660:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 11 00000100:00100000:1.0:1788830527.836675:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2445999500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2154ea6-69cb-4a30-aac0-000fba13e98b+6:0:x1875724578335360:12345-192.168.201.21@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788830527.836782:0:5832:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788830527.836908:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2445999500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2154ea6-69cb-4a30-aac0-000fba13e98b+6:0:x1875724578335360:12345-192.168.201.21@tcp:41:mount.lustre.0 Request processed in 236us (880us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830527.836917:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 11 00000100:00100000:0.0:1788830527.840072:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830527.840206:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578335488 00000100:00100000:2.0:1788830527.840221:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578335488 00000100:00100000:2.0:1788830527.840309:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 12 00000100:00100000:2.0:1788830527.840341:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e244599b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2154ea6-69cb-4a30-aac0-000fba13e98b+6:8122:x1875724578335488:12345-192.168.201.21@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788830527.840385:0:5834:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788830527.840481:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e244599b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2154ea6-69cb-4a30-aac0-000fba13e98b+6:8122:x1875724578335488:12345-192.168.201.21@tcp:41:mount.lustre.0 Request processed in 143us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830527.840489:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 12 00000100:00100000:2.0:1788830527.853836:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830527.854321:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578335616 00000100:00100000:1.0:1788830527.854335:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578335616 00000100:00100000:1.0:1788830527.854422:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 13 00000100:00100000:1.0:1788830527.854436:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25478b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2154ea6-69cb-4a30-aac0-000fba13e98b+6:8122:x1875724578335616:12345-192.168.201.21@tcp:40:mount.lustre.0 00000100:00100000:1.0:1788830527.854560:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25478b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2154ea6-69cb-4a30-aac0-000fba13e98b+6:8122:x1875724578335616:12345-192.168.201.21@tcp:40:mount.lustre.0 Request processed in 128us (742us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830527.854568:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 13 00000100:00100000:0.0:1788830527.857175:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830527.857479:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578335744 00000100:00100000:2.0:1788830527.857495:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578335744 00000100:00100000:2.0:1788830527.857557:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 14 00000100:00100000:2.0:1788830527.857568:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e244599b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2351:x1875724578335744:12345-192.168.201.21@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788830527.857611:0:6677:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from c2154ea6-69cb-4a30-aac0-000fba13e98b@192.168.201.21@tcp t0 exp 0000000000000000 cur 281 last 0 00000020:00000080:2.0:1788830527.857659:0:6677:0:(genops.c:1385:class_connect()) connect: client c2154ea6-69cb-4a30-aac0-000fba13e98b, cookie 0x575506951eea0bba 00002000:00100000:2.0:1788830527.857675:0:6677:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli c2154ea6-69cb-4a30-aac0-000fba13e98b/ffff9e25475d9800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113968 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788830527.857758:0:6677:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788830527.858917:0:6677:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788830527.858990:0:6677:0:(import.c:65:import_set_state_nolock()) ffff9e25475d8800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788830527.859252:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e244599b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c2154ea6-69cb-4a30-aac0-000fba13e98b+6:2351:x1875724578335744:12345-192.168.201.21@tcp:8:mount.lustre.0 Request processed in 1681us (2089us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830527.859263:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 14 00000100:00100000:0.0:1788830527.861935:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830527.861997:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830527.862094:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578336000 00000100:00100000:1.0:1788830527.862109:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578336000 00000100:00100000:1.0:1788830527.862227:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 1 00000100:00100000:1.0:1788830527.862242:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2445998e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c2154ea6-69cb-4a30-aac0-000fba13e98b+6:8122:x1875724578336000:12345-192.168.201.21@tcp:33:mount.lustre.0 00000004:00200000:1.0:1788830527.862380:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1788830527.862506:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2445998e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c2154ea6-69cb-4a30-aac0-000fba13e98b+6:8122:x1875724578336000:12345-192.168.201.21@tcp:33:mount.lustre.0 Request processed in 267us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830527.862517:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 1 00000100:00100000:2.0:1788830527.873581:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578335872 00000100:00100000:2.0:1788830527.873607:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578335872 00000100:00100000:2.0:1788830527.873702:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 15 00000100:00100000:2.0:1788830527.873761:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2445999180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2351:x1875724578335872:12345-192.168.201.21@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788830527.873810:0:6680:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from c2154ea6-69cb-4a30-aac0-000fba13e98b@192.168.201.21@tcp t0 exp 0000000000000000 cur 281 last 0 00000020:00000080:2.0:1788830527.873863:0:6680:0:(genops.c:1385:class_connect()) connect: client c2154ea6-69cb-4a30-aac0-000fba13e98b, cookie 0x575506951eea0bc1 00002000:00100000:2.0:1788830527.873898:0:6680:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli c2154ea6-69cb-4a30-aac0-000fba13e98b/ffff9e25475db800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113968 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788830527.873913:0:6680:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788830527.874324:0:6680:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788830527.874373:0:6680:0:(import.c:65:import_set_state_nolock()) ffff9e25475d8000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788830527.874498:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2445999180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c2154ea6-69cb-4a30-aac0-000fba13e98b+6:2351:x1875724578335872:12345-192.168.201.21@tcp:8:mount.lustre.0 Request processed in 737us (12575us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830527.874508:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 15 00000001:00100000:3.0:1788830528.280916:0:5855:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of c2154ea6-69cb-4a30-aac0-000fba13e98b 00010000:00010000:1.0:1788830528.541157:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788830528.813960:0:7646:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of c2154ea6-69cb-4a30-aac0-000fba13e98b 00010000:00010000:2.0:1788830529.564496:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788830530.269408:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788830530.269443:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e244599a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875724595144320:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788830530.269538:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830530.269677:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595144320 00000100:00100000:0.0:1788830530.269689:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595144320 00000100:00100000:0.0:1788830530.270006:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788830530.270019:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25478b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875724595144320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788830530.270074:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788830530.270137:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25478b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875724595144320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 120us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830530.270145:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:2.0:1788830530.270223:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788830530.270651:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e244599a680 x1875724595144320/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788830546 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788830530.270679:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e244599a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875724595144320:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788830530.593028:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788830530.849073:0:6709:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c2154ea6-69cb-4a30-aac0-000fba13e98b 00000100:00100000:0.0:1788830531.295501:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257f727100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875724595144576:0@lo:400:kworker.0 00000100:00100000:0.0:1788830531.295612:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788830531.295809:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e244599a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1745cc3d-3952-4cd4-9020-9b8acb483105:3308:1875724595144448:0@lo:400:kworker.0 00000100:00100000:2.0:1788830531.295851:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788830531.295893:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595144576 00000100:00100000:2.0:1788830531.295901:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595144576 00000100:00100000:2.0:1788830531.295961:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788830531.295969:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2547240000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875724595144576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788830531.296021:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2547240000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875724595144576:12345-0@lo:400:kworker.0 Request processed in 52us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830531.296028:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788830531.296055:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595144448 00000100:00100000:2.0:1788830531.296059:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595144448 00000100:00100000:2.0:1788830531.296085:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1788830531.296092:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2574710450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+19:3308:x1875724595144448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788830531.297800:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2574710450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+19:3308:x1875724595144448:12345-0@lo:400:kworker.0 Request processed in 33us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830531.297839:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1788830531.298085:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257f727100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875724595144576:0@lo:400:kworker.0 00000100:00100000:0.0:1788830531.298101:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2547242300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875724595145088:0@lo:400:kworker.0 00000100:00100000:0.0:1788830531.298304:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830531.298376:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2547241180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875724595144704:0@lo:400:kworker.0 00000100:00100000:0.0:1788830531.298407:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830531.298445:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2547243100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1875724595144832:0@lo:400:kworker.0 00000100:00100000:0.0:1788830531.298476:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830531.298516:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595144832 00000100:00100000:0.0:1788830531.298525:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595144832 00000100:00100000:0.0:1788830531.298595:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788830531.298605:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2547241500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875724595144832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788830531.300691:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595145088 00000100:00100000:2.0:1788830531.300726:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595145088 00000100:00100000:2.0:1788830531.300798:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595144704 00000100:00100000:2.0:1788830531.300802:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595144704 00000100:00100000:2.0:1788830531.300823:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788830531.300833:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2547243b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875724595145088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788830531.300934:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2547243b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875724595145088:12345-0@lo:400:kworker.0 Request processed in 102us (2631us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830531.300942:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788830531.300958:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788830531.300964:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2547241c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875724595144704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788830531.301000:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2547241c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875724595144704:12345-0@lo:400:kworker.0 Request processed in 36us (2593us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830531.301006:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:2.0:1788830531.301030:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788830531.301037:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788830531.301098:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e244599a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1745cc3d-3952-4cd4-9020-9b8acb483105:3308:1875724595144448:0@lo:400:kworker.0 00000100:00100000:2.0:1788830531.301115:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2547240380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1875724595144960:0@lo:400:kworker.0 00000100:00100000:0.0:1788830531.301390:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2547241500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875724595144832:12345-0@lo:400:kworker.0 Request processed in 61us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830531.301405:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:3.0:1788830531.302499:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e2547242300 x1875724595145088/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788830547 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788830531.302520:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2547242300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875724595145088:0@lo:400:kworker.0 00010000:00080000:0.0:1788830531.302634:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e2547241180 x1875724595144704/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788830547 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788830531.302646:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2547241180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875724595144704:0@lo:400:kworker.0 00000100:00100000:2.0:1788830531.302825:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788830531.302884:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595144960 00000100:00100000:2.0:1788830531.302892:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595144960 00000100:00100000:2.0:1788830531.302946:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788830531.302954:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25478b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875724595144960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788830531.303005:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25478b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875724595144960:12345-0@lo:400:kworker.0 Request processed in 51us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830531.303033:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:2.0:1788830531.303056:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788830531.303077:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2547240380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1875724595144960:0@lo:400:kworker.0 00000100:00100000:3.0:1788830531.304051:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2547243100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1875724595144832:0@lo:400:kworker.0 00010000:00010000:2.0:1788830531.612030:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788830531.805889:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788830531.805940:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2545cbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875724595145216:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788830531.806034:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830531.806881:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595145216 00000100:00100000:3.0:1788830531.806896:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595145216 00000100:00100000:3.0:1788830531.806975:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788830531.806988:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25472fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875724595145216:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788830531.807038:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788830531.807142:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25472fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875724595145216:12345-0@lo:13:osp-pre-1-0.0 Request processed in 156us (1106us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830531.807151:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:2.0:1788830531.807325:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e2545cbf480 x1875724595145216/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788830547 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788830531.807360:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2545cbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875724595145216:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788830532.635952:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788830532.997980:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830532.998037:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830532.998069:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830532.998098:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830532.998121:0:8202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578336384 00000100:00100000:0.0:1788830532.998126:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830532.998148:0:8202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578336384 00000100:00100000:0.0:1788830532.998156:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578336640 00000100:00100000:0.0:1788830532.998171:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578336640 00000100:00100000:3.0:1788830532.998240:0:8202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578336256 00000100:00100000:0.0:1788830532.998241:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578336512 00000100:00100000:3.0:1788830532.998245:0:8202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578336256 00000100:00100000:0.0:1788830532.998248:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578336512 00000100:00100000:3.0:1788830532.998281:0:8202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 57 00000100:00100000:0.0:1788830532.998285:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 34 00000100:00100000:0.0:1788830532.998298:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2547242680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c2154ea6-69cb-4a30-aac0-000fba13e98b+5:2352:x1875724578336640:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:3.0:1788830532.998308:0:8202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2547241180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2154ea6-69cb-4a30-aac0-000fba13e98b+5:2352:x1875724578336384:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:1.0:1788830532.998399:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578336128 00000100:00100000:1.0:1788830532.998404:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578336128 00000100:00100000:1.0:1788830532.998439:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 218 00000100:00100000:1.0:1788830532.998448:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2574713450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+13:2352:x1875724578336128:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:0.0:1788830532.998523:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2547242680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c2154ea6-69cb-4a30-aac0-000fba13e98b+5:2352:x1875724578336640:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 227us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830532.998531:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 34 00000100:00100000:0.0:1788830532.998551:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 35 00000100:00100000:0.0:1788830532.998558:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2547241f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c2154ea6-69cb-4a30-aac0-000fba13e98b+5:2352:x1875724578336512:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:2.0:1788830533.000873:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 58 00000100:00100000:2.0:1788830533.000901:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2547240e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+6:2352:x1875724578336256:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:3.0:1788830533.002992:0:8202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2547241180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2154ea6-69cb-4a30-aac0-000fba13e98b+5:2352:x1875724578336384:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 4682us (4936us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830533.003012:0:8202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 57 00000100:00080000:3.0:1788830533.004122:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788830533.004133:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788830533.004137:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788830533.005739:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2574713450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+13:2352:x1875724578336128:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 7260us (7743us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830533.005759:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 218 00000100:00100000:0.0:1788830533.008873:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2547241f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c2154ea6-69cb-4a30-aac0-000fba13e98b+5:2352:x1875724578336512:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 10292us (10723us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830533.008898:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 35 00000100:00100000:2.0:1788830533.014360:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2547240e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+6:2352:x1875724578336256:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 13454us (16242us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830533.014380:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 58 00000001:02000400:3.0:1788830533.513305:0:10312:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg121-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:0.0:1788830533.660318:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788830534.683879:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788830535.400154:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25478b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875724595145344:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788830535.400268:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788830535.400391:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595145344 00000100:00100000:2.0:1788830535.400403:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595145344 00000100:00100000:2.0:1788830535.400491:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788830535.400503:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2545cbca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875724595145344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788830535.400561:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788830535.400629:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2545cbca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875724595145344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 128us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830535.400637:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:2.0:1788830535.400690:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e25478b5c00 x1875724595145344/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788830551 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788830535.400774:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25478b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875724595145344:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788830535.401336:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788830535.718480:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788830536.415967:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2545cbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1745cc3d-3952-4cd4-9020-9b8acb483105:3308:1875724595145472:0@lo:400:kworker.0 00000100:00100000:0.0:1788830536.416077:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830536.417197:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595145472 00000100:00100000:1.0:1788830536.417212:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595145472 00000100:00100000:1.0:1788830536.417285:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1788830536.417296:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2574712c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1745cc3d-3952-4cd4-9020-9b8acb483105+19:3308:x1875724595145472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788830536.421291:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2574712c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1745cc3d-3952-4cd4-9020-9b8acb483105+19:3308:x1875724595145472:12345-0@lo:400:kworker.0 Request processed in 3982us (5199us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830536.421312:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1788830536.421572:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2545cbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1875724595145856:0@lo:400:kworker.0 00000100:00100000:3.0:1788830536.421646:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830536.421699:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788830536.421706:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2545cbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1875724595145984:0@lo:400:kworker.0 00000100:00100000:3.0:1788830536.421774:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830536.421805:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2545cbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875724595145600:0@lo:400:kworker.0 00000100:00100000:3.0:1788830536.421832:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830536.421850:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2545cbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875724595146112:0@lo:400:kworker.0 00000100:00100000:3.0:1788830536.421876:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830536.421898:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788830536.421904:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2545cbf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875724595145728:0@lo:400:kworker.0 00000100:00100000:3.0:1788830536.421949:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830536.421984:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595145856 00000100:00100000:3.0:1788830536.421994:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595145856 00000100:00100000:3.0:1788830536.422055:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595145984 00000100:00100000:3.0:1788830536.422059:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595145984 00000100:00100000:3.0:1788830536.422074:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595145600 00000100:00100000:3.0:1788830536.422076:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595145600 00000100:00100000:3.0:1788830536.422091:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788830536.422102:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2545cbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875724595145856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788830536.422200:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2545cbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875724595145856:12345-0@lo:400:kworker.0 Request processed in 100us (554us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830536.422206:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788830536.422222:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788830536.422228:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2545cbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875724595145984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788830536.422254:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2545cbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875724595145984:12345-0@lo:400:kworker.0 Request processed in 27us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830536.422260:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788830536.422271:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788830536.422276:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2545cbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875724595145600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788830536.422308:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2545cbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875724595145600:12345-0@lo:400:kworker.0 Request processed in 32us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830536.422314:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788830536.422337:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595146112 00000100:00100000:3.0:1788830536.422340:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595146112 00000100:00100000:3.0:1788830536.422368:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595145728 00000100:00100000:3.0:1788830536.422371:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595145728 00000100:00100000:3.0:1788830536.422384:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788830536.422390:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2545cbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875724595146112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788830536.422429:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2545cbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875724595146112:12345-0@lo:400:kworker.0 Request processed in 39us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830536.422436:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788830536.422446:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788830536.422452:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257fbd2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875724595145728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788830536.422474:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257fbd2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875724595145728:12345-0@lo:400:kworker.0 Request processed in 23us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830536.422480:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:3.0:1788830536.422662:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788830536.422668:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788830536.422905:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e2545cbf800 x1875724595145728/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788830552 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788830536.422922:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2545cbf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875724595145728:0@lo:400:kworker.0 00000100:00100000:3.0:1788830536.422936:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2545cbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875724595145600:0@lo:400:kworker.0 00010000:00080000:3.0:1788830536.422946:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e2545cbd180 x1875724595146112/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788830552 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788830536.422955:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2545cbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875724595146112:0@lo:400:kworker.0 00000100:00100000:3.0:1788830536.422994:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2545cbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1875724595145984:0@lo:400:kworker.0 00000100:00100000:3.0:1788830536.423005:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2545cbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1875724595145856:0@lo:400:kworker.0 00000100:00100000:0.0:1788830536.424141:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2545cbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1745cc3d-3952-4cd4-9020-9b8acb483105:3308:1875724595145472:0@lo:400:kworker.0 00010000:00010000:1.0:1788830536.734023:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788830536.923966:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788830536.923999:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2545cbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875724595146240:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788830536.924090:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830536.931691:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595146240 00000100:00100000:1.0:1788830536.931750:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595146240 00000100:00100000:1.0:1788830536.931836:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788830536.931849:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2545cbd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875724595146240:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788830536.931905:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788830536.932015:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2545cbd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875724595146240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 169us (7924us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830536.932023:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:3.0:1788830536.932181:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e2545cbc700 x1875724595146240/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788830552 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788830536.932227:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2545cbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875724595146240:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788830537.755952:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788830538.119301:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830538.119344:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830538.119374:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830538.119393:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830538.119426:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830538.119460:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578337024 00000100:00100000:0.0:1788830538.119472:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578337024 00000100:00100000:0.0:1788830538.119568:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578336896 00000100:00100000:0.0:1788830538.119573:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578336896 00000100:00100000:0.0:1788830538.119600:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 62 00000100:00100000:0.0:1788830538.119611:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2547243480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2154ea6-69cb-4a30-aac0-000fba13e98b+5:2353:x1875724578337024:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:0.0:1788830538.119744:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2547243480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2154ea6-69cb-4a30-aac0-000fba13e98b+5:2353:x1875724578337024:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 134us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830538.119754:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 62 00000100:00100000:0.0:1788830538.119777:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 63 00000100:00100000:0.0:1788830538.119784:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2547242a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+6:2353:x1875724578336896:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:0.0:1788830538.123072:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2547242a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+6:2353:x1875724578336896:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 3264us (3654us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830538.123106:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 63 00000100:00100000:0.0:1788830538.123191:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578337280 00000100:00100000:0.0:1788830538.123204:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578337280 00000100:00100000:0.0:1788830538.123273:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578337152 00000100:00100000:0.0:1788830538.123276:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578337152 00000100:00100000:0.0:1788830538.123300:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 38 00000100:00100000:0.0:1788830538.123309:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2547240a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c2154ea6-69cb-4a30-aac0-000fba13e98b+5:2353:x1875724578337280:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:0.0:1788830538.123385:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2547240a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c2154ea6-69cb-4a30-aac0-000fba13e98b+5:2353:x1875724578337280:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 77us (4010us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830538.123391:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 38 00000100:00100000:0.0:1788830538.123403:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 39 00000100:00100000:0.0:1788830538.123409:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2547242d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c2154ea6-69cb-4a30-aac0-000fba13e98b+5:2353:x1875724578337152:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:0.0:1788830538.123434:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2547242d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c2154ea6-69cb-4a30-aac0-000fba13e98b+5:2353:x1875724578337152:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 25us (4007us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830538.123464:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 39 00000100:00080000:0.0:1788830538.123493:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788830538.123498:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788830538.123501:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788830538.126021:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578336768 00000100:00100000:1.0:1788830538.126059:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578336768 00000100:00100000:1.0:1788830538.126140:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 220 00000100:00100000:1.0:1788830538.126152:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2574710850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+13:2353:x1875724578336768:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:1.0:1788830538.126251:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2574710850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+13:2353:x1875724578336768:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 102us (6968us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830538.126259:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 220 00010000:00010000:1.0:1788830538.781772:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788830539.807236:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788830540.511612:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25478b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875724595146368:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788830540.511758:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830540.518300:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595146368 00000100:00100000:3.0:1788830540.518326:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595146368 00000100:00100000:3.0:1788830540.518435:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788830540.518449:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2547243800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875724595146368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788830540.518511:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788830540.518652:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2547243800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875724595146368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 206us (6893us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830540.518660:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:1.0:1788830540.518801:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e25478b5c00 x1875724595146368/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788830556 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788830540.518828:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25478b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875724595146368:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788830540.518944:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788830540.829692:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788830541.532913:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2545cbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1745cc3d-3952-4cd4-9020-9b8acb483105:3308:1875724595146496:0@lo:400:kworker.0 00000100:00100000:2.0:1788830541.533055:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788830541.533151:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2545cbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1875724595147008:0@lo:400:kworker.0 00000100:00100000:2.0:1788830541.533195:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788830541.533230:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788830541.533237:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2545cbf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1875724595146880:0@lo:400:kworker.0 00000100:00100000:2.0:1788830541.533258:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788830541.533297:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595146496 00000100:00100000:2.0:1788830541.533307:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595146496 00000100:00100000:2.0:1788830541.533647:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1788830541.533661:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2574710c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1745cc3d-3952-4cd4-9020-9b8acb483105+19:3308:x1875724595146496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788830541.533771:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2574710c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1745cc3d-3952-4cd4-9020-9b8acb483105+19:3308:x1875724595146496:12345-0@lo:400:kworker.0 Request processed in 113us (715us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830541.533779:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1788830541.533817:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595147008 00000100:00100000:2.0:1788830541.533821:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595147008 00000100:00100000:2.0:1788830541.533859:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595146880 00000100:00100000:2.0:1788830541.533862:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595146880 00000100:00100000:2.0:1788830541.533884:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788830541.533890:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25478b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875724595147008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788830541.533924:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25478b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875724595147008:12345-0@lo:400:kworker.0 Request processed in 34us (728us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830541.533930:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788830541.533940:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788830541.533945:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25478b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875724595146880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788830541.533980:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25478b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875724595146880:12345-0@lo:400:kworker.0 Request processed in 35us (720us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830541.534001:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:2.0:1788830541.534026:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788830541.534089:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2545cbf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1875724595146880:0@lo:400:kworker.0 00000100:00100000:2.0:1788830541.534101:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2545cbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1745cc3d-3952-4cd4-9020-9b8acb483105:3308:1875724595146496:0@lo:400:kworker.0 00000100:00100000:2.0:1788830541.534123:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2545cbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1875724595147008:0@lo:400:kworker.0 00000100:00100000:3.0:1788830541.534610:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2545cbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875724595146624:0@lo:400:kworker.0 00000100:00100000:3.0:1788830541.534653:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830541.534693:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2545cbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875724595147136:0@lo:400:kworker.0 00000100:00100000:3.0:1788830541.534735:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830541.534758:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788830541.534764:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2545cbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875724595146752:0@lo:400:kworker.0 00000100:00100000:3.0:1788830541.534784:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830541.534811:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595147136 00000100:00100000:3.0:1788830541.534815:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595147136 00000100:00100000:3.0:1788830541.534850:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595146752 00000100:00100000:3.0:1788830541.534853:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595146752 00000100:00100000:3.0:1788830541.534866:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788830541.534872:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2545cbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875724595147136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788830541.534911:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2545cbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875724595147136:12345-0@lo:400:kworker.0 Request processed in 39us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830541.534918:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788830541.534941:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788830541.534946:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2545cbe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875724595146752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788830541.535089:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2545cbe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875724595146752:12345-0@lo:400:kworker.0 Request processed in 142us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830541.535096:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:3.0:1788830541.535153:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e2545cbed80 x1875724595146752/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788830557 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788830541.535165:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2545cbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875724595146752:0@lo:400:kworker.0 00010000:00080000:3.0:1788830541.535398:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e2545cbc000 x1875724595147136/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788830557 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788830541.535411:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2545cbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875724595147136:0@lo:400:kworker.0 00000100:00080000:2.0:1788830541.535497:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788830541.535510:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595146624 00000100:00100000:2.0:1788830541.535514:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595146624 00000100:00100000:2.0:1788830541.535555:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788830541.535562:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2545cbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875724595146624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788830541.535607:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2545cbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875724595146624:12345-0@lo:400:kworker.0 Request processed in 46us (953us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830541.535613:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788830541.535641:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2545cbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875724595146624:0@lo:400:kworker.0 00010000:00010000:0.0:1788830541.853895:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788830542.043925:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2545cbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875724595147264:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788830542.044004:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830542.044118:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595147264 00000100:00100000:1.0:1788830542.044126:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595147264 00000100:00100000:1.0:1788830542.044182:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788830542.044191:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25478b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875724595147264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788830542.044243:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788830542.044591:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25478b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875724595147264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 399us (584us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830542.044599:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:2.0:1788830542.049538:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e2545cbc000 x1875724595147264/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788830558 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788830542.049567:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2545cbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875724595147264:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788830542.883813:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788830543.239859:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830543.240033:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578337408 00000100:00100000:2.0:1788830543.240043:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578337408 00000100:00100000:2.0:1788830543.240105:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 222 00000100:00100000:2.0:1788830543.240115:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2574712050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+13:2355:x1875724578337408:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:2.0:1788830543.240202:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2574712050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+13:2355:x1875724578337408:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 88us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830543.240209:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 222 00000100:00100000:1.0:1788830543.243273:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830543.243499:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578337536 00000100:00100000:2.0:1788830543.243511:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578337536 00000100:00100000:2.0:1788830543.243603:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 67 00000100:00100000:2.0:1788830543.243614:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25472fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+6:2355:x1875724578337536:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:2.0:1788830543.243738:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25472fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+6:2355:x1875724578337536:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 96us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830543.243746:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 67 00000100:00080000:0.0:1788830543.244527:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788830543.248824:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830543.248865:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830543.248901:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830543.249090:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578337792 00000100:00100000:3.0:1788830543.249101:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578337792 00000100:00100000:3.0:1788830543.249165:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578337920 00000100:00100000:3.0:1788830543.249169:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578337920 00000100:00100000:3.0:1788830543.249187:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 42 00000100:00100000:3.0:1788830543.249196:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2547241880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c2154ea6-69cb-4a30-aac0-000fba13e98b+5:2354:x1875724578337792:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:3.0:1788830543.249262:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2547241880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c2154ea6-69cb-4a30-aac0-000fba13e98b+5:2354:x1875724578337792:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 67us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830543.249275:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 42 00000100:00100000:3.0:1788830543.249293:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 43 00000100:00100000:3.0:1788830543.249299:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2547243b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c2154ea6-69cb-4a30-aac0-000fba13e98b+5:2354:x1875724578337920:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:3.0:1788830543.249325:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2547243b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c2154ea6-69cb-4a30-aac0-000fba13e98b+5:2354:x1875724578337920:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 25us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830543.249348:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 43 00000100:00100000:2.0:1788830543.249425:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578337664 00000100:00100000:2.0:1788830543.249430:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578337664 00000100:00100000:2.0:1788830543.249471:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 68 00000100:00100000:2.0:1788830543.249479:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2547240700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2154ea6-69cb-4a30-aac0-000fba13e98b+5:2354:x1875724578337664:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:2.0:1788830543.249508:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2547240700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2154ea6-69cb-4a30-aac0-000fba13e98b+5:2354:x1875724578337664:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 31us (698us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830543.249514:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 68 00000100:00080000:0.0:1788830543.250157:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788830543.250163:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788830543.250165:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788830543.907437:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788830544.928950:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788830545.634543:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788830545.634567:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25478b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875724595147392:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788830545.634637:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788830545.634701:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595147392 00000100:00100000:2.0:1788830545.634729:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595147392 00000100:00100000:2.0:1788830545.634796:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788830545.634806:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25478b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875724595147392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788830545.634955:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788830545.635018:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25478b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875724595147392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 214us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830545.635026:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:2.0:1788830545.635047:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788830545.635077:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e25478b5f80 x1875724595147392/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788830561 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788830545.635097:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25478b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875724595147392:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788830545.949945:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788830546.318093:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830546.318142:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830546.318400:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578338176 00000100:00100000:2.0:1788830546.318411:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578338176 00000100:00080000:0.0:1788830546.318483:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788830546.318511:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 69 00000100:00100000:2.0:1788830546.318522:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2547241c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+6:2353:x1875724578338176:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:2.0:1788830546.318606:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2547241c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+6:2353:x1875724578338176:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 86us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830546.318614:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 69 00000100:00100000:3.0:1788830546.318845:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578338432 00000100:00100000:3.0:1788830546.318850:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578338432 00000100:00100000:3.0:1788830546.319162:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 44 00000100:00100000:3.0:1788830546.319171:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2547242680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c2154ea6-69cb-4a30-aac0-000fba13e98b+5:2353:x1875724578338432:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:3.0:1788830546.319206:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2547242680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c2154ea6-69cb-4a30-aac0-000fba13e98b+5:2353:x1875724578338432:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 37us (1064us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830546.319213:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 44 00000100:00100000:2.0:1788830546.321662:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830546.321700:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830546.321823:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830546.321979:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578338048 00000100:00100000:3.0:1788830546.321989:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578338048 00000100:00100000:3.0:1788830546.322082:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 223 00000100:00100000:3.0:1788830546.322091:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2574711850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+13:2353:x1875724578338048:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:3.0:1788830546.322161:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2574711850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+13:2353:x1875724578338048:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 71us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830546.322168:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 223 00000100:00100000:2.0:1788830546.322689:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578338304 00000100:00100000:2.0:1788830546.322695:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578338304 00000100:00100000:3.0:1788830546.323288:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578338560 00000100:00100000:3.0:1788830546.323294:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578338560 00000100:00080000:0.0:1788830546.323371:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788830546.323397:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788830546.323400:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788830546.323508:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 70 00000100:00100000:2.0:1788830546.323518:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25478b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2154ea6-69cb-4a30-aac0-000fba13e98b+5:2353:x1875724578338304:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:2.0:1788830546.323578:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25478b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2154ea6-69cb-4a30-aac0-000fba13e98b+5:2353:x1875724578338304:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 62us (1876us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830546.323584:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 70 00000100:00100000:3.0:1788830546.324128:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 45 00000100:00100000:3.0:1788830546.324137:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25478b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c2154ea6-69cb-4a30-aac0-000fba13e98b+5:2353:x1875724578338560:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:3.0:1788830546.324170:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25478b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c2154ea6-69cb-4a30-aac0-000fba13e98b+5:2353:x1875724578338560:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 34us (2347us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830546.324176:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 45 00000100:00100000:2.0:1788830546.653434:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25478b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1875724595147904:0@lo:400:kworker.0 00000100:00100000:2.0:1788830546.653522:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788830546.653748:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788830546.653755:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25478b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1745cc3d-3952-4cd4-9020-9b8acb483105:3307:1875724595147520:0@lo:400:kworker.0 00000100:00100000:2.0:1788830546.653785:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788830546.653807:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25478b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1875724595148032:0@lo:400:kworker.0 00000100:00100000:2.0:1788830546.653828:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788830546.653853:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25478b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875724595147648:0@lo:400:kworker.0 00000100:00100000:2.0:1788830546.653875:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788830546.653891:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25478b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875724595148160:0@lo:400:kworker.0 00000100:00100000:2.0:1788830546.653912:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788830546.653930:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788830546.653935:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25478b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875724595147776:0@lo:400:kworker.0 00000100:00100000:2.0:1788830546.653970:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788830546.654004:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595147904 00000100:00100000:2.0:1788830546.654014:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595147904 00000100:00100000:2.0:1788830546.654065:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595148032 00000100:00100000:2.0:1788830546.654069:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595148032 00000100:00100000:2.0:1788830546.654082:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595147648 00000100:00100000:2.0:1788830546.654084:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595147648 00000100:00100000:2.0:1788830546.654099:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788830546.654107:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25478b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875724595147904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788830546.654355:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25478b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1875724595147904:0@lo:400:kworker.0 00000100:00100000:2.0:1788830546.654915:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25478b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875724595147904:12345-0@lo:400:kworker.0 Request processed in 806us (1390us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830546.654923:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788830546.654954:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788830546.654965:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25478b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875724595148032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788830546.655026:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25478b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875724595148032:12345-0@lo:400:kworker.0 Request processed in 64us (1196us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830546.655034:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788830546.655046:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788830546.655052:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e244599b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875724595147648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788830546.655084:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e244599b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875724595147648:12345-0@lo:400:kworker.0 Request processed in 32us (1208us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830546.655090:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788830546.655110:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595147520 00000100:00100000:2.0:1788830546.655114:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595147520 00000100:00100000:2.0:1788830546.655141:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1788830546.655147:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2574713050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1745cc3d-3952-4cd4-9020-9b8acb483105+19:3307:x1875724595147520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788830546.655178:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2574713050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1745cc3d-3952-4cd4-9020-9b8acb483105+19:3307:x1875724595147520:12345-0@lo:400:kworker.0 Request processed in 31us (1391us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830546.655184:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1788830546.655217:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595148160 00000100:00100000:2.0:1788830546.655220:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595148160 00000100:00100000:2.0:1788830546.655243:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595147776 00000100:00100000:2.0:1788830546.655246:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595147776 00000100:00100000:2.0:1788830546.655257:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788830546.656082:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25478b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1745cc3d-3952-4cd4-9020-9b8acb483105:3307:1875724595147520:0@lo:400:kworker.0 00000100:00100000:1.0:1788830546.656100:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25478b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1875724595148032:0@lo:400:kworker.0 00000100:00100000:2.0:1788830546.656178:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e244599a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875724595148160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788830546.656226:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e244599a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875724595148160:12345-0@lo:400:kworker.0 Request processed in 56us (2312us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830546.656233:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788830546.656250:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788830546.656257:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e244599bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875724595147776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788830546.656663:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e244599bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875724595147776:12345-0@lo:400:kworker.0 Request processed in 406us (2692us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830546.656670:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:2.0:1788830546.656926:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e25478b7800 x1875724595147776/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788830562 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788830546.656938:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25478b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875724595147776:0@lo:400:kworker.0 00000100:00100000:2.0:1788830546.656963:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25478b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875724595147648:0@lo:400:kworker.0 00010000:00080000:2.0:1788830546.656974:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e25478b5c00 x1875724595148160/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788830562 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788830546.656983:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25478b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875724595148160:0@lo:400:kworker.0 00000100:00080000:0.0:1788830546.663036:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788830546.663047:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788830546.975181:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788830547.164197:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2545cbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875724595148288:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788830547.164384:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830547.164555:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595148288 00000100:00100000:3.0:1788830547.164565:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595148288 00000100:00100000:3.0:1788830547.164623:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788830547.164633:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2547241f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875724595148288:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788830547.164674:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788830547.164778:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2547241f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875724595148288:12345-0@lo:13:osp-pre-1-0.0 Request processed in 145us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830547.164785:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:0.0:1788830547.165141:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e2545cbed80 x1875724595148288/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788830563 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788830547.165162:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2545cbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875724595148288:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788830547.997193:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788830549.020851:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788830550.044077:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788830550.527510:0:11012:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:2.0:1788830550.748927:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788830550.748954:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e244599b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875724595148416:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788830550.749022:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788830550.749095:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595148416 00000100:00100000:2.0:1788830550.749102:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595148416 00000100:00100000:2.0:1788830550.749156:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788830550.749164:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2445999180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875724595148416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788830550.749199:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788830550.749241:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2445999180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875724595148416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830550.749247:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:2.0:1788830550.749267:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788830550.749307:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e244599b800 x1875724595148416/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788830566 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788830550.749339:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e244599b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875724595148416:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788830551.068142:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788830551.435164:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830551.435217:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830551.435256:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830551.435276:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830551.435298:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830551.435378:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578338944 00000100:00100000:0.0:1788830551.435388:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578338944 00000100:00100000:0.0:1788830551.435459:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578338816 00000100:00100000:0.0:1788830551.435463:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578338816 00000100:00100000:0.0:1788830551.435496:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 74 00000100:00100000:0.0:1788830551.435508:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2545cbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2154ea6-69cb-4a30-aac0-000fba13e98b+5:2354:x1875724578338944:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:0.0:1788830551.435594:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2545cbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2154ea6-69cb-4a30-aac0-000fba13e98b+5:2354:x1875724578338944:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 88us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830551.435602:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 74 00000100:00100000:0.0:1788830551.435617:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 75 00000100:00100000:0.0:1788830551.435623:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2545cbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+6:2354:x1875724578338816:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:0.0:1788830551.435645:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2545cbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+6:2354:x1875724578338816:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 22us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830551.435650:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 75 00000100:00100000:2.0:1788830551.436373:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578338688 00000100:00100000:2.0:1788830551.436383:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578338688 00000100:00100000:2.0:1788830551.436439:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 225 00000100:00100000:2.0:1788830551.436459:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2574710050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+13:2354:x1875724578338688:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:2.0:1788830551.436508:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2574710050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+13:2354:x1875724578338688:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 51us (1356us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830551.436514:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 225 00000100:00100000:2.0:1788830551.436571:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578339072 00000100:00100000:2.0:1788830551.436575:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578339072 00000100:00100000:2.0:1788830551.436601:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578339200 00000100:00100000:2.0:1788830551.436604:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578339200 00000100:00100000:2.0:1788830551.436620:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 16 00000100:00100000:2.0:1788830551.436626:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2545cbea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c2154ea6-69cb-4a30-aac0-000fba13e98b+5:2351:x1875724578339072:12345-192.168.201.21@tcp:9:kworker.0 00000020:00000080:2.0:1788830551.436645:0:6679:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x575506951eea0bba 00000100:00080000:2.0:1788830551.436655:0:6679:0:(import.c:65:import_set_state_nolock()) ffff9e25475d8800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788830551.436689:0:6679:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00080000:3.0:1788830551.436781:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788830551.436786:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788830551.436788:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788830551.437127:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2545cbea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c2154ea6-69cb-4a30-aac0-000fba13e98b+2:2351:x1875724578339072:12345-192.168.201.21@tcp:9:kworker.0 Request processed in 499us (1848us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830551.437136:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 16 00000100:00100000:2.0:1788830551.437150:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 17 00000100:00100000:2.0:1788830551.437157:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2545cbf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c2154ea6-69cb-4a30-aac0-000fba13e98b+5:2351:x1875724578339200:12345-192.168.201.21@tcp:9:kworker.0 00000020:00000080:2.0:1788830551.437169:0:6679:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x575506951eea0bc1 00000100:00080000:2.0:1788830551.437175:0:6679:0:(import.c:65:import_set_state_nolock()) ffff9e25475d8000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788830551.437197:0:6679:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1788830551.437461:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2545cbf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c2154ea6-69cb-4a30-aac0-000fba13e98b+2:2351:x1875724578339200:12345-192.168.201.21@tcp:9:kworker.0 Request processed in 304us (2161us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830551.437469:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 17 00010000:00010000:2.0:1788830551.437487:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788830551.438034:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788830551.776595:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2545cbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1875724595148928:0@lo:400:kworker.0 00000100:00100000:3.0:1788830551.776677:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830551.776787:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788830551.776794:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2545cbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1745cc3d-3952-4cd4-9020-9b8acb483105:3307:1875724595148544:0@lo:400:kworker.0 00000100:00100000:3.0:1788830551.776822:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830551.776843:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25478b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1875724595149056:0@lo:400:kworker.0 00000100:00100000:3.0:1788830551.776873:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830551.776897:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2545cbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875724595148672:0@lo:400:kworker.0 00000100:00100000:3.0:1788830551.776934:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830551.776952:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25478b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875724595149184:0@lo:400:kworker.0 00000100:00100000:3.0:1788830551.776974:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830551.776994:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788830551.776999:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2545cbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875724595148800:0@lo:400:kworker.0 00000100:00100000:3.0:1788830551.777021:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830551.777054:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595148928 00000100:00100000:3.0:1788830551.777062:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595148928 00000100:00100000:3.0:1788830551.777112:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595149056 00000100:00100000:3.0:1788830551.777115:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595149056 00000100:00100000:3.0:1788830551.777129:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595148672 00000100:00100000:3.0:1788830551.777132:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595148672 00000100:00100000:3.0:1788830551.777146:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788830551.777154:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25478b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875724595148928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788830551.777209:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25478b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875724595148928:12345-0@lo:400:kworker.0 Request processed in 55us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830551.777216:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788830551.777232:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788830551.777238:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25478b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875724595149056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788830551.777264:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25478b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875724595149056:12345-0@lo:400:kworker.0 Request processed in 26us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830551.777269:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788830551.777279:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788830551.777284:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25478b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875724595148672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788830551.777310:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25478b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875724595148672:12345-0@lo:400:kworker.0 Request processed in 26us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830551.777315:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788830551.777338:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595148544 00000100:00100000:3.0:1788830551.777341:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595148544 00000100:00100000:3.0:1788830551.777364:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1788830551.777371:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255d949450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+19:3307:x1875724595148544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788830551.777400:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255d949450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+19:3307:x1875724595148544:12345-0@lo:400:kworker.0 Request processed in 29us (577us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830551.777406:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1788830551.777440:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595149184 00000100:00100000:3.0:1788830551.777444:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595149184 00000100:00100000:3.0:1788830551.777468:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595148800 00000100:00100000:3.0:1788830551.777471:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595148800 00000100:00100000:3.0:1788830551.777484:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788830551.777490:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25478b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875724595149184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788830551.777518:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25478b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875724595149184:12345-0@lo:400:kworker.0 Request processed in 28us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830551.777523:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788830551.777535:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788830551.777541:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25479a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875724595148800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788830551.777570:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25479a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875724595148800:12345-0@lo:400:kworker.0 Request processed in 30us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830551.777576:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:3.0:1788830551.777594:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788830551.777598:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788830551.777630:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e2545cbc000 x1875724595148800/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788830567 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788830551.777644:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2545cbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875724595148800:0@lo:400:kworker.0 00000100:00100000:3.0:1788830551.777655:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2545cbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875724595148672:0@lo:400:kworker.0 00010000:00080000:3.0:1788830551.777675:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e25478b6d80 x1875724595149184/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788830567 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788830551.777683:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25478b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875724595149184:0@lo:400:kworker.0 00000100:00100000:3.0:1788830551.777739:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2545cbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1745cc3d-3952-4cd4-9020-9b8acb483105:3307:1875724595148544:0@lo:400:kworker.0 00000100:00100000:3.0:1788830551.777748:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25478b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1875724595149056:0@lo:400:kworker.0 00000100:00100000:3.0:1788830551.777755:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2545cbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1875724595148928:0@lo:400:kworker.0 00010000:00010000:2.0:1788830552.092034:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788830552.287253:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25472ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875724595149312:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788830552.287325:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830552.288887:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595149312 00000100:00100000:1.0:1788830552.288901:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595149312 00000100:00100000:1.0:1788830552.288961:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788830552.288970:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2547243100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875724595149312:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788830552.289015:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788830552.289091:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2547243100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875724595149312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 122us (1765us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830552.289099:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:1.0:1788830552.289407:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e25472ffb80 x1875724595149312/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788830568 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788830552.289428:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25472ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875724595149312:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788830553.118758:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788830554.079416:0:11159:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcd50f0b40 20000000:00000080:2.0:1788830554.079435:0:11159:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9e2446d65800 uarg=0000000000000000 20000000:01000000:2.0:1788830554.079471:0:11159:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788830554.079476:0:11159:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788830554.079481:0:11159:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1788830554.080628:0:11160:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:2.0:1788830554.081574:0:11159:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1788830554.096038:0:11159:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788830554.096066:0:11159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2565728e00/0x575506951eea0bc8 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830554.096087:0:11159:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e257d944a00/0x575506951eea0b6d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661bfc expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830554.096096:0:11159:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e25820ff400/0x575506951eea0b7b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x575506951eea0b74 expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830554.096102:0:11159:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2445b7e200/0x575506951eea0b89 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x575506951eea0b82 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830554.096108:0:11159:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2445b7fc00/0x575506951eea0b97 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x575506951eea0b90 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830554.096115:0:11159:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e25820ffa00/0x575506951eea0bac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661c34 expref: 12 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830554.096137:0:11159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2565728e00/0x575506951eea0bc8 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830554.096181:0:11159:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e25820ffa00/0x575506951eea0bac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.21@tcp remote: 0xa578910534661c34 expref: 12 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830554.096197:0:11159:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e25820ffa00/0x575506951eea0bac lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661c34 expref: 12 pid: 5824 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788830554.096213:0:11159:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e244599b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11159:1875724595149440:192.168.201.21@tcp:104: 00010000:00010000:2.0:1788830554.096357:0:11159:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2445b7fc00/0x575506951eea0b97 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x575506951eea0b90 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830554.096366:0:11159:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e2445b7fc00/0x575506951eea0b97 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x575506951eea0b90 expref: 18 pid: 5827 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788830554.096376:0:11159:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e244599a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11159:1875724595149568:0@lo:104: 00000100:00100000:2.0:1788830554.096417:0:11159:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788830554.096458:0:11159:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2445b7e200/0x575506951eea0b89 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x575506951eea0b82 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830554.096467:0:11159:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e2445b7e200/0x575506951eea0b89 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x575506951eea0b82 expref: 18 pid: 5826 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788830554.096475:0:11159:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e255005f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11159:1875724595149696:0@lo:104: 00000100:00100000:2.0:1788830554.096493:0:11159:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788830554.096521:0:11159:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e25820ff400/0x575506951eea0b7b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x575506951eea0b74 expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830554.096541:0:11159:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e25820ff400/0x575506951eea0b7b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x575506951eea0b74 expref: 18 pid: 5824 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788830554.096549:0:11159:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e255005f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11159:1875724595149824:0@lo:104: 00000100:00100000:2.0:1788830554.096569:0:11159:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788830554.096588:0:11159:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e257d944a00/0x575506951eea0b6d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.21@tcp remote: 0xa578910534661bfc expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830554.096596:0:11159:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e257d944a00/0x575506951eea0b6d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661bfc expref: 12 pid: 5827 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788830554.096604:0:11159:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e255005c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11159:1875724595149952:192.168.201.21@tcp:104: 00000100:00100000:2.0:1788830554.096624:0:11159:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2565b94e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788830554.096680:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595149568 00000100:00100000:3.0:1788830554.096688:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595149568 00000100:00100000:3.0:1788830554.096756:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595149696 00000100:00100000:3.0:1788830554.096760:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595149696 00000100:00100000:3.0:1788830554.096770:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595149824 00000100:00100000:3.0:1788830554.096772:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595149824 00000100:00100000:3.0:1788830554.096783:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788830554.096790:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255005ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1745cc3d-3952-4cd4-9020-9b8acb483105+5:11159:x1875724595149568:12345-0@lo:104: 00010000:00010000:3.0:1788830554.096802:0:5815:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.121@tcp lock: ffff9e2445b7e400/0x575506951eea0b90 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x575506951eea0b97 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830554.096870:0:5815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788830554.096877:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255005ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1745cc3d-3952-4cd4-9020-9b8acb483105+5:11159:x1875724595149568:12345-0@lo:104: Request processed in 87us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830554.096883:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788830554.096899:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788830554.096905:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255005d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1745cc3d-3952-4cd4-9020-9b8acb483105+4:11159:x1875724595149696:12345-0@lo:104: 00010000:00010000:3.0:1788830554.096912:0:5815:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.121@tcp lock: ffff9e2445b7ec00/0x575506951eea0b82 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x575506951eea0b89 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830554.096949:0:5815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788830554.096954:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255005d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1745cc3d-3952-4cd4-9020-9b8acb483105+4:11159:x1875724595149696:12345-0@lo:104: Request processed in 50us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830554.096960:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788830554.096970:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788830554.096975:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255005e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1745cc3d-3952-4cd4-9020-9b8acb483105+3:11159:x1875724595149824:12345-0@lo:104: 00010000:00010000:3.0:1788830554.096982:0:5815:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.121@tcp lock: ffff9e2445b7f800/0x575506951eea0b74 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x575506951eea0b7b expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830554.097004:0:5815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788830554.097008:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255005e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1745cc3d-3952-4cd4-9020-9b8acb483105+3:11159:x1875724595149824:12345-0@lo:104: Request processed in 33us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830554.097013:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:3.0:1788830554.097027:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788830554.097033:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.121@tcp lock: ffff9e2445b7e400/0x575506951eea0b90 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x575506951eea0b97 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830554.097040:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2445b7e400 already unused, calling callback (ffffffffc1aebc20) 10000000:00010000:3.0:1788830554.097044:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.121@tcp lock: ffff9e2445b7e400/0x575506951eea0b90 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x575506951eea0b97 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830554.097054:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.121@tcp lock: ffff9e2445b7e400/0x575506951eea0b90 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x575506951eea0b97 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788830554.097061:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.121@tcp lock: ffff9e2445b7e400/0x575506951eea0b90 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x575506951eea0b97 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788830554.097066:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788830554.097101:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.121@tcp lock: ffff9e2445b7e400/0x575506951eea0b90 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x575506951eea0b97 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830554.097107:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788830554.097127:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.121@tcp lock: ffff9e2445b7e400/0x575506951eea0b90 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x575506951eea0b97 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830554.097133:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.121@tcp lock: ffff9e2445b7e400/0x575506951eea0b90 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x575506951eea0b97 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830554.097146:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788830554.097149:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.121@tcp lock: ffff9e2445b7ec00/0x575506951eea0b82 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x575506951eea0b89 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830554.097154:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2445b7ec00 already unused, calling callback (ffffffffc1aebc20) 10000000:00010000:3.0:1788830554.097156:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.121@tcp lock: ffff9e2445b7ec00/0x575506951eea0b82 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x575506951eea0b89 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830554.097162:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.121@tcp lock: ffff9e2445b7ec00/0x575506951eea0b82 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x575506951eea0b89 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788830554.097167:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.121@tcp lock: ffff9e2445b7ec00/0x575506951eea0b82 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x575506951eea0b89 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788830554.097172:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788830554.097184:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.121@tcp lock: ffff9e2445b7ec00/0x575506951eea0b82 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x575506951eea0b89 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830554.097191:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788830554.097197:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.121@tcp lock: ffff9e2445b7ec00/0x575506951eea0b82 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x575506951eea0b89 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830554.097212:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.121@tcp lock: ffff9e2445b7ec00/0x575506951eea0b82 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x575506951eea0b89 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830554.097221:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788830554.097225:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.121@tcp lock: ffff9e2445b7f800/0x575506951eea0b74 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x575506951eea0b7b expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830554.097231:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2445b7f800 already unused, calling callback (ffffffffc1aebc20) 10000000:00010000:3.0:1788830554.097233:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.121@tcp lock: ffff9e2445b7f800/0x575506951eea0b74 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x575506951eea0b7b expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830554.097239:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.121@tcp lock: ffff9e2445b7f800/0x575506951eea0b74 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x575506951eea0b7b expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788830554.097244:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.121@tcp lock: ffff9e2445b7f800/0x575506951eea0b74 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x575506951eea0b7b expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788830554.097250:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788830554.097262:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.121@tcp lock: ffff9e2445b7f800/0x575506951eea0b74 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x575506951eea0b7b expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830554.097268:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788830554.097282:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.121@tcp lock: ffff9e2445b7f800/0x575506951eea0b74 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x575506951eea0b7b expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830554.097289:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.121@tcp lock: ffff9e2445b7f800/0x575506951eea0b74 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x575506951eea0b7b expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830554.097301:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788830554.097307:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788830554.097309:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788830554.097317:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788830554.097336:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25479a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1745cc3d-3952-4cd4-9020-9b8acb483105:3307:1875724595150080:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788830554.097367:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830554.097388:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788830554.097394:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25479a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1745cc3d-3952-4cd4-9020-9b8acb483105:3307:1875724595150208:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788830554.097414:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830554.097442:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25479a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1745cc3d-3952-4cd4-9020-9b8acb483105:3309:1875724595150336:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788830554.097463:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830554.097495:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595150080 00000100:00100000:3.0:1788830554.097499:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595150080 00010000:00010000:3.0:1788830554.097517:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2445b7fc00/0x575506951eea0b97 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x575506951eea0b90 expref: 19 pid: 5827 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788830554.097532:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595150208 00000100:00100000:3.0:1788830554.097534:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595150208 00010000:00010000:3.0:1788830554.097542:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2445b7e200/0x575506951eea0b89 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x575506951eea0b82 expref: 20 pid: 5826 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788830554.097551:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595150336 00000100:00100000:3.0:1788830554.097553:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595150336 00010000:00010000:3.0:1788830554.097561:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e25820ff400/0x575506951eea0b7b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x575506951eea0b74 expref: 21 pid: 5824 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788830554.097573:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788830554.097579:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2547435c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1745cc3d-3952-4cd4-9020-9b8acb483105+21:3307:x1875724595150080:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788830554.097588:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788830554.097594:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2445b7fc00/0x575506951eea0b97 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x575506951eea0b90 expref: 21 pid: 5827 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830554.097608:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2445b7fc00/0x575506951eea0b97 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x575506951eea0b90 expref: 21 pid: 5827 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830554.097622:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788830554.097649:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2547435c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1745cc3d-3952-4cd4-9020-9b8acb483105+21:3307:x1875724595150080:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830554.097655:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788830554.097693:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788830554.097698:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25479a0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1745cc3d-3952-4cd4-9020-9b8acb483105+20:3307:x1875724595150208:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788830554.097705:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788830554.097731:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2445b7e200/0x575506951eea0b89 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x575506951eea0b82 expref: 20 pid: 5826 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830554.097739:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2445b7e200/0x575506951eea0b89 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x575506951eea0b82 expref: 20 pid: 5826 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830554.097747:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788830554.097768:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25479a0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1745cc3d-3952-4cd4-9020-9b8acb483105+20:3307:x1875724595150208:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830554.097774:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788830554.097785:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788830554.097791:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25479a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1745cc3d-3952-4cd4-9020-9b8acb483105+19:3309:x1875724595150336:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788830554.097798:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788830554.097802:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e25820ff400/0x575506951eea0b7b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x575506951eea0b74 expref: 19 pid: 5824 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830554.097809:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e25820ff400/0x575506951eea0b7b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x575506951eea0b74 expref: 19 pid: 5824 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830554.097838:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788830554.097864:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25479a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1745cc3d-3952-4cd4-9020-9b8acb483105+19:3309:x1875724595150336:12345-0@lo:103:ldlm_bl.0 Request processed in 74us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830554.097870:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788830554.097907:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25479a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1745cc3d-3952-4cd4-9020-9b8acb483105:3309:1875724595150336:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788830554.097930:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25479a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1745cc3d-3952-4cd4-9020-9b8acb483105:3307:1875724595150208:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788830554.097936:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25479a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1745cc3d-3952-4cd4-9020-9b8acb483105:3307:1875724595150080:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788830554.098187:0:11159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2445b7fc00/0x575506951eea0b97 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x575506951eea0b90 expref: 18 pid: 5827 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788830554.098199:0:11159:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e244599a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11159:1875724595149568:0@lo:104: 00010000:00010000:2.0:1788830554.098207:0:11159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2445b7e200/0x575506951eea0b89 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x575506951eea0b82 expref: 17 pid: 5826 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788830554.098215:0:11159:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e255005f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11159:1875724595149696:0@lo:104: 00010000:00010000:2.0:1788830554.098222:0:11159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e25820ff400/0x575506951eea0b7b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x575506951eea0b74 expref: 16 pid: 5824 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788830554.098230:0:11159:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e255005f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11159:1875724595149824:0@lo:104: 00000100:00100000:0.0:1788830554.104614:0:11159:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e255005c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11159:1875724595149952:192.168.201.21@tcp:104: 00000100:00100000:2.0:1788830554.116048:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830554.116191:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830554.116229:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578339456 00000100:00100000:3.0:1788830554.116239:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578339456 00010000:00010000:3.0:1788830554.116284:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e25820ffa00/0x575506951eea0bac lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661c34 expref: 13 pid: 5824 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788830554.116322:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578339328 00000100:00100000:3.0:1788830554.116325:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578339328 00010000:00010000:3.0:1788830554.116338:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e257d944a00/0x575506951eea0b6d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661bfc expref: 14 pid: 5827 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788830554.116352:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 28 00000100:00100000:3.0:1788830554.116360:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255005f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+14:2354:x1875724578339456:12345-192.168.201.21@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788830554.116612:0:5817:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1788830554.116622:0:5817:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:1.0:1788830554.116760:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 29 00000100:00100000:1.0:1788830554.116768:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25479a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+14:2354:x1875724578339328:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788830554.116778:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788830554.116785:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e257d944a00/0x575506951eea0b6d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661bfc expref: 14 pid: 5827 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830554.116797:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e257d944a00/0x575506951eea0b6d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661bfc expref: 14 pid: 5827 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830554.116816:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e257d944a00/0x575506951eea0b6d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661bfc expref: 14 pid: 5827 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830554.116841:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788830554.116885:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25479a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+13:2354:x1875724578339328:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 118us (694us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830554.116892:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 29 00010000:00010000:3.0:1788830554.117324:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788830554.117332:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e25820ffa00/0x575506951eea0bac lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661c34 expref: 12 pid: 5824 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830554.117342:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e25820ffa00/0x575506951eea0bac lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661c34 expref: 12 pid: 5824 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830554.117368:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2565728e00/0x575506951eea0bc8 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830554.117376:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2565728e00/0x575506951eea0bc8 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830554.117390:0:5818:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2565728e00/0x575506951eea0bc8 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830554.117397:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2565728e00/0x575506951eea0bc8 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830554.117403:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2565728e00/0x575506951eea0bc8 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830554.117410:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2565728e00/0x575506951eea0bc8 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830554.117416:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2565728e00 already unused, calling callback (ffffffffc14cb350) 00010000:00010000:3.0:1788830554.117421:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2565728e00/0x575506951eea0bc8 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830554.117429:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2565728e00/0x575506951eea0bc8 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830554.117437:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2565728e00/0x575506951eea0bc8 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830554.117446:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788830554.117484:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255005f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+12:2354:x1875724578339456:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 1124us (1790us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830554.117499:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 28 00010000:00010000:0.0:1788830554.117652:0:11159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e25820ffa00/0x575506951eea0bac lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661c34 expref: 11 pid: 5824 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788830554.117677:0:11159:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e244599b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11159:1875724595149440:192.168.201.21@tcp:104: 00010000:00010000:0.0:1788830554.117884:0:11159:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2565728e00/0x575506951eea0bc8 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830554.117894:0:11159:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2565728e00/0x575506951eea0bc8 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830554.117901:0:11159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2565728e00/0x575506951eea0bc8 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830554.117907:0:11159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2565728e00/0x575506951eea0bc8 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830554.141961:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788830554.356637:0:7646:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of c2154ea6-69cb-4a30-aac0-000fba13e98b 00000020:00000080:0.0:1788830554.356645:0:7646:0:(genops.c:885:class_export_put()) final put ffff9e25475db800/c2154ea6-69cb-4a30-aac0-000fba13e98b 00000020:00000080:3.0:1788830554.356794:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e25475db800/c2154ea6-69cb-4a30-aac0-000fba13e98b for lustre-OST0001 00000020:00000080:3.0:1788830554.356859:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e25475d8000 for lustre-OST0001 00010000:00010000:3.0:1788830555.163883:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788830555.205858:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830555.208641:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578339584 00000100:00100000:2.0:1788830555.208662:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578339584 00000100:00100000:2.0:1788830555.208747:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 227 00000100:00100000:2.0:1788830555.208758:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255d949050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+11:5593:x1875724578339584:12345-192.168.201.21@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788830555.208774:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788830555.208792:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2565729a00/0x575506951eea0bcf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa578910534661c5e expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830555.208830:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2565729a00/0x575506951eea0bcf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661c5e expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830555.208840:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2565729a00/0x575506951eea0bcf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661c5e expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830555.208849:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2565729a00, rc 0) 00000100:00100000:2.0:1788830555.208915:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255d949050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+12:5593:x1875724578339584:12345-192.168.201.21@tcp:101:ll_cfg_requeue.0 Request processed in 158us (3066us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830555.208921:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 227 00000100:00100000:3.0:1788830555.212296:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830555.212433:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578339712 00000100:00100000:2.0:1788830555.212444:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578339712 00000100:00100000:2.0:1788830555.212615:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 228 00000100:00100000:2.0:1788830555.212625:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255d94b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+12:5593:x1875724578339712:12345-192.168.201.21@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788830555.212954:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255d94b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+12:5593:x1875724578339712:12345-192.168.201.21@tcp:501:ll_cfg_requeue.0 Request processed in 330us (669us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830555.212963:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 228 00000100:00100000:1.0:1788830555.218497:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830555.219425:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578339840 00000100:00100000:2.0:1788830555.219437:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578339840 00000100:00100000:2.0:1788830555.219502:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 229 00000100:00100000:2.0:1788830555.219514:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255d948850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+12:5593:x1875724578339840:12345-192.168.201.21@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788830555.219807:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255d948850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+12:5593:x1875724578339840:12345-192.168.201.21@tcp:503:ll_cfg_requeue.0 Request processed in 287us (1312us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830555.219816:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 229 00000100:00100000:3.0:1788830555.246353:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830555.246430:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578339968 00000100:00100000:2.0:1788830555.246441:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578339968 00000100:00100000:2.0:1788830555.246504:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 230 00000100:00100000:2.0:1788830555.246514:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255d948050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+12:5593:x1875724578339968:12345-192.168.201.21@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788830555.246530:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788830555.246571:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2565728e00/0x575506951eea0bd6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa578910534661c65 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830555.246600:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2565728e00/0x575506951eea0bd6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661c65 expref: 13 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830555.246612:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2565728e00/0x575506951eea0bd6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661c65 expref: 13 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830555.246620:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2565728e00, rc 0) 00000100:00100000:2.0:1788830555.246677:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255d948050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+13:5593:x1875724578339968:12345-192.168.201.21@tcp:101:ll_cfg_requeue.0 Request processed in 164us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830555.246683:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 230 00000100:00100000:3.0:1788830555.253489:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830555.255460:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578340096 00000100:00100000:0.0:1788830555.255475:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578340096 00000100:00100000:0.0:1788830555.255550:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 231 00000100:00100000:0.0:1788830555.255641:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255d949c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+13:5593:x1875724578340096:12345-192.168.201.21@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788830555.256100:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255d949c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+13:5593:x1875724578340096:12345-192.168.201.21@tcp:501:ll_cfg_requeue.0 Request processed in 539us (2617us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830555.256121:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 231 00000100:00100000:0.0:1788830555.260931:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830555.266021:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578340224 00000100:00100000:1.0:1788830555.266037:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578340224 00000100:00100000:1.0:1788830555.266109:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 232 00000100:00100000:1.0:1788830555.266119:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255d94a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+13:5593:x1875724578340224:12345-192.168.201.21@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788830555.266606:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255d94a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+13:5593:x1875724578340224:12345-192.168.201.21@tcp:503:ll_cfg_requeue.0 Request processed in 487us (5684us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830555.266616:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 232 10000000:01000000:1.0:1788830555.616645:0:5829:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788830555.616656:0:5829:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e2444ab0800 from 7 10000000:01000000:1.0:1788830555.616663:0:5829:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788830555.616745:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.121@tcp lock: ffff9e25820ffe00/0x575506951eea0bdd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830555.616760:0:5829:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.121@tcp lock: ffff9e25820ffe00/0x575506951eea0bdd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830555.616775:0:5829:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.121@tcp lock: ffff9e25820ffe00/0x575506951eea0bdd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788830555.616819:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25472ffb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1745cc3d-3952-4cd4-9020-9b8acb483105:5829:1875724595150464:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788830555.616915:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830555.616992:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2545d2c780 going to sleep for 11 seconds 00000100:00100000:2.0:1788830555.617083:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595150464 00000100:00100000:2.0:1788830555.617094:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595150464 00000100:00100000:2.0:1788830555.617164:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1788830555.617175:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255d948450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1745cc3d-3952-4cd4-9020-9b8acb483105+16:5829:x1875724595150464:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788830555.617192:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788830555.617210:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2565728c00/0x575506951eea0be4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x575506951eea0bdd expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830555.617251:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2565728c00/0x575506951eea0be4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x575506951eea0bdd expref: 17 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830555.617263:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2565728c00/0x575506951eea0be4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x575506951eea0bdd expref: 17 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830555.617274:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2565728c00, rc 0) 00000100:00100000:2.0:1788830555.617338:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255d948450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1745cc3d-3952-4cd4-9020-9b8acb483105+17:5829:x1875724595150464:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 164us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830555.617346:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1788830555.617511:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25472ffb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1745cc3d-3952-4cd4-9020-9b8acb483105:5829:1875724595150464:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788830555.617529:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.121@tcp lock: ffff9e25820ffe00/0x575506951eea0bdd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea0be4 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830555.617539:0:5829:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.121@tcp lock: ffff9e25820ffe00/0x575506951eea0bdd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x575506951eea0be4 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788830555.617608:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25479a2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1745cc3d-3952-4cd4-9020-9b8acb483105:5829:1875724595150592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788830555.617641:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830555.617678:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2545cc96c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788830555.617744:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595150592 00000100:00100000:1.0:1788830555.617749:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595150592 00000100:00100000:1.0:1788830555.617785:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1788830555.617803:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255d94ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1745cc3d-3952-4cd4-9020-9b8acb483105+17:5829:x1875724595150592:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788830555.618184:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255d94ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1745cc3d-3952-4cd4-9020-9b8acb483105+17:5829:x1875724595150592:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 390us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830555.618191:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1788830555.618301:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25479a2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1745cc3d-3952-4cd4-9020-9b8acb483105:5829:1875724595150592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788830555.618336:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25479a2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1745cc3d-3952-4cd4-9020-9b8acb483105:5829:1875724595150720:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788830555.618380:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830555.618409:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2545cc96c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788830555.618504:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595150720 00000100:00100000:1.0:1788830555.618509:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595150720 00000100:00100000:1.0:1788830555.618541:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1788830555.618549:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2574711450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1745cc3d-3952-4cd4-9020-9b8acb483105+17:5829:x1875724595150720:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788830555.618750:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2574711450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1745cc3d-3952-4cd4-9020-9b8acb483105+17:5829:x1875724595150720:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 201us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830555.618757:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1788830555.618849:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25479a2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1745cc3d-3952-4cd4-9020-9b8acb483105:5829:1875724595150720:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788830555.628840:0:11184:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1788830555.629099:0:5829:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1788830555.629123:0:5829:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788830555.629138:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: ffff9e25820ffe00/0x575506951eea0bdd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea0be4 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830555.629154:0:5829:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.121@tcp lock: ffff9e25820ffe00/0x575506951eea0bdd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea0be4 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788830555.629169:0:5829:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788830555.629173:0:5829:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e2565dcd800 from 7 10000000:01000000:1.0:1788830555.629176:0:5829:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788830555.629233:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.121@tcp lock: ffff9e25820ffa00/0x575506951eea0beb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830555.629243:0:5829:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.121@tcp lock: ffff9e25820ffa00/0x575506951eea0beb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830555.629257:0:5829:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.121@tcp lock: ffff9e25820ffa00/0x575506951eea0beb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788830555.629309:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25472ff480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1745cc3d-3952-4cd4-9020-9b8acb483105:5829:1875724595150848:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788830555.629404:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830555.629461:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2545d2c780 going to sleep for 11 seconds 00000100:00100000:2.0:1788830555.629541:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595150848 00000100:00100000:2.0:1788830555.629552:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595150848 00000100:00100000:2.0:1788830555.629618:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1788830555.629630:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255d948c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1745cc3d-3952-4cd4-9020-9b8acb483105+17:5829:x1875724595150848:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788830555.629648:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788830555.629665:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2565729400/0x575506951eea0bf2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x575506951eea0beb expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830555.629695:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2565729400/0x575506951eea0bf2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x575506951eea0beb expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830555.629738:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2565729400/0x575506951eea0bf2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x575506951eea0beb expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830555.629748:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2565729400, rc 0) 00000100:00100000:2.0:1788830555.629810:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255d948c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1745cc3d-3952-4cd4-9020-9b8acb483105+18:5829:x1875724595150848:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 181us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830555.629817:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1788830555.629935:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25472ff480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1745cc3d-3952-4cd4-9020-9b8acb483105:5829:1875724595150848:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788830555.629951:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.121@tcp lock: ffff9e25820ffa00/0x575506951eea0beb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea0bf2 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830555.629960:0:5829:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.121@tcp lock: ffff9e25820ffa00/0x575506951eea0beb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x575506951eea0bf2 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788830555.630033:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25472ff480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1745cc3d-3952-4cd4-9020-9b8acb483105:5829:1875724595150976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788830555.630061:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830555.630091:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2545d2c780 going to sleep for 11 seconds 00000100:00100000:2.0:1788830555.630145:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595150976 00000100:00100000:2.0:1788830555.630149:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595150976 00000100:00100000:2.0:1788830555.630183:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1788830555.630191:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255d94b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+18:5829:x1875724595150976:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788830555.630513:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255d94b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+18:5829:x1875724595150976:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 321us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830555.630520:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1788830555.630612:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25472ff480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1745cc3d-3952-4cd4-9020-9b8acb483105:5829:1875724595150976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788830555.630646:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25472ff480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1745cc3d-3952-4cd4-9020-9b8acb483105:5829:1875724595151104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788830555.630689:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830555.630735:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2545d2c780 going to sleep for 11 seconds 00000100:00100000:2.0:1788830555.630946:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595151104 00000100:00100000:2.0:1788830555.630952:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595151104 00000100:00100000:2.0:1788830555.630990:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1788830555.630998:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255d94a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+18:5829:x1875724595151104:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788830555.631169:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255d94a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+18:5829:x1875724595151104:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 172us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830555.631176:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1788830555.631424:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25472ff480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1745cc3d-3952-4cd4-9020-9b8acb483105:5829:1875724595151104:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788830555.632293:0:11185:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1788830555.635337:0:5829:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1788830555.635391:0:5829:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788830555.635408:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: ffff9e25820ffa00/0x575506951eea0beb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea0bf2 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830555.635423:0:5829:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.121@tcp lock: ffff9e25820ffa00/0x575506951eea0beb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea0bf2 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788830555.635455:0:5829:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788830555.635458:0:5829:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e255d9b0800 from 7 10000000:01000000:1.0:1788830555.635461:0:5829:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788830555.635514:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.121@tcp lock: ffff9e25820ff200/0x575506951eea0bf9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830555.635523:0:5829:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.121@tcp lock: ffff9e25820ff200/0x575506951eea0bf9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830555.635537:0:5829:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.121@tcp lock: ffff9e25820ff200/0x575506951eea0bf9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788830555.635571:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25472ff480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1745cc3d-3952-4cd4-9020-9b8acb483105:5829:1875724595151232:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788830555.635672:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830555.635840:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2545d2c780 going to sleep for 11 seconds 00000100:00100000:3.0:1788830555.640142:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595151232 00000100:00100000:3.0:1788830555.640161:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595151232 00000100:00100000:3.0:1788830555.640233:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1788830555.640244:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255d949850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+18:5829:x1875724595151232:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788830555.640267:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788830555.640291:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e257d944000/0x575506951eea0c00 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x575506951eea0bf9 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830555.640329:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e257d944000/0x575506951eea0c00 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x575506951eea0bf9 expref: 19 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830555.640343:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e257d944000/0x575506951eea0c00 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x575506951eea0bf9 expref: 19 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830555.640355:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e257d944000, rc 0) 00000100:00100000:3.0:1788830555.640455:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255d949850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+19:5829:x1875724595151232:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 212us (4783us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830555.640463:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1788830555.640995:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25472ff480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1745cc3d-3952-4cd4-9020-9b8acb483105:5829:1875724595151232:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788830555.641026:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.121@tcp lock: ffff9e25820ff200/0x575506951eea0bf9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea0c00 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830555.641038:0:5829:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.121@tcp lock: ffff9e25820ff200/0x575506951eea0bf9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x575506951eea0c00 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788830555.641137:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25472ff480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1745cc3d-3952-4cd4-9020-9b8acb483105:5829:1875724595151360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788830555.641191:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830555.641240:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2545d2c780 going to sleep for 11 seconds 00000100:00100000:2.0:1788830555.647043:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595151360 00000100:00100000:2.0:1788830555.647065:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595151360 00000100:00100000:2.0:1788830555.647144:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1788830555.647155:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255d94b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1745cc3d-3952-4cd4-9020-9b8acb483105+19:5829:x1875724595151360:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788830555.647579:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255d94b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1745cc3d-3952-4cd4-9020-9b8acb483105+19:5829:x1875724595151360:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 424us (6385us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830555.647588:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1788830555.647667:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25472ff480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1745cc3d-3952-4cd4-9020-9b8acb483105:5829:1875724595151360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788830555.647777:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e255005ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1745cc3d-3952-4cd4-9020-9b8acb483105:5829:1875724595151488:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788830555.647849:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788830555.647888:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e24452d86c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788830555.647905:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595151488 00000100:00100000:2.0:1788830555.647916:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595151488 00000100:00100000:2.0:1788830555.647947:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1788830555.647955:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255d94a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1745cc3d-3952-4cd4-9020-9b8acb483105+19:5829:x1875724595151488:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788830555.648131:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255d94a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1745cc3d-3952-4cd4-9020-9b8acb483105+19:5829:x1875724595151488:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 177us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830555.648138:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1788830555.648176:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e255005ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1745cc3d-3952-4cd4-9020-9b8acb483105:5829:1875724595151488:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788830555.648974:0:11187:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1788830555.649043:0:5829:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1788830555.649067:0:5829:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788830555.649078:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: ffff9e25820ff200/0x575506951eea0bf9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea0c00 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830555.649092:0:5829:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.121@tcp lock: ffff9e25820ff200/0x575506951eea0bf9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea0c00 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788830555.868796:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e255005ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875724595151616:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788830555.868903:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830555.869002:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595151616 00000100:00100000:3.0:1788830555.869011:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595151616 00000100:00100000:3.0:1788830555.869081:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788830555.869092:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25479a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875724595151616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788830555.869142:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788830555.869195:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25479a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875724595151616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830555.869217:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:3.0:1788830555.869242:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788830555.869278:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e255005ce00 x1875724595151616/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788830571 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788830555.869299:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e255005ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875724595151616:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788830556.195323:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788830556.468116:0:6709:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c2154ea6-69cb-4a30-aac0-000fba13e98b 00000020:00000080:3.0:1788830556.468124:0:6709:0:(genops.c:885:class_export_put()) final put ffff9e25475d9800/c2154ea6-69cb-4a30-aac0-000fba13e98b 00000020:00000080:3.0:1788830556.468157:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e25475d9800/c2154ea6-69cb-4a30-aac0-000fba13e98b for lustre-OST0000 00000020:00000080:3.0:1788830556.468197:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e25475d8800 for lustre-OST0000 00000100:00100000:1.0:1788830556.557517:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830556.557578:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830556.557619:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830556.557653:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578340352 00000100:00100000:1.0:1788830556.557663:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578340352 00000100:00100000:1.0:1788830556.557749:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 242 00000100:00100000:1.0:1788830556.557760:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255d94bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+13:2353:x1875724578340352:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:3.0:1788830556.557762:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578340480 00000100:00100000:3.0:1788830556.557769:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578340480 00000100:00100000:3.0:1788830556.557846:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578340608 00000100:00100000:3.0:1788830556.557850:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578340608 00000100:00100000:1.0:1788830556.557855:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255d94bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+13:2353:x1875724578340352:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 97us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830556.557865:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 242 00000100:00100000:3.0:1788830556.557878:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 79 00000100:00100000:3.0:1788830556.557888:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25472fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+6:2352:x1875724578340480:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:3.0:1788830556.557928:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25472fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+6:2352:x1875724578340480:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 42us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830556.557936:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 79 00000100:00100000:3.0:1788830556.557954:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 80 00000100:00100000:3.0:1788830556.557961:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25472fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2154ea6-69cb-4a30-aac0-000fba13e98b+5:2353:x1875724578340608:12345-192.168.201.21@tcp:400:kworker.0 00000100:00080000:1.0:1788830556.558659:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788830556.559875:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25472fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2154ea6-69cb-4a30-aac0-000fba13e98b+5:2353:x1875724578340608:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 1907us (2247us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830556.559886:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 80 00000100:00100000:3.0:1788830556.894850:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25478b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875724595151872:0@lo:400:kworker.0 00000100:00100000:3.0:1788830556.894942:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830556.895002:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2545cbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875724595152384:0@lo:400:kworker.0 00000100:00100000:3.0:1788830556.895028:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830556.895058:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788830556.895064:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25479a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1745cc3d-3952-4cd4-9020-9b8acb483105:3308:1875724595151744:0@lo:400:kworker.0 00000100:00100000:3.0:1788830556.895092:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830556.895113:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2545cbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1875724595152256:0@lo:400:kworker.0 00000100:00100000:3.0:1788830556.895132:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830556.895156:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25478b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875724595152000:0@lo:400:kworker.0 00000100:00100000:3.0:1788830556.895177:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830556.895194:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788830556.895199:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2545cbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875724595152128:0@lo:400:kworker.0 00000100:00100000:3.0:1788830556.895219:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830556.895248:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595151872 00000100:00100000:3.0:1788830556.895254:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595151872 00000100:00100000:3.0:1788830556.895292:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595152256 00000100:00100000:3.0:1788830556.895295:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595152256 00000100:00100000:3.0:1788830556.895318:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595152128 00000100:00100000:3.0:1788830556.895321:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595152128 00000100:00100000:3.0:1788830556.895336:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788830556.895344:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2545cbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875724595151872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788830556.895395:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2545cbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875724595151872:12345-0@lo:400:kworker.0 Request processed in 51us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830556.895403:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788830556.895418:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788830556.895424:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25654eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875724595152256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788830556.895463:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25654eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875724595152256:12345-0@lo:400:kworker.0 Request processed in 39us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830556.895468:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788830556.895480:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788830556.895485:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25654e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875724595152128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788830556.895513:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25654e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875724595152128:12345-0@lo:400:kworker.0 Request processed in 27us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830556.895518:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788830556.895534:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595152384 00000100:00100000:3.0:1788830556.895537:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595152384 00000100:00100000:3.0:1788830556.895987:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595152000 00000100:00100000:3.0:1788830556.895992:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595152000 00000100:00100000:3.0:1788830556.896006:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788830556.896012:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25654e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875724595152384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788830556.896047:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25654e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875724595152384:12345-0@lo:400:kworker.0 Request processed in 35us (1018us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830556.896053:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788830556.896064:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788830556.896069:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25654e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875724595152000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788830556.896096:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25654e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875724595152000:12345-0@lo:400:kworker.0 Request processed in 27us (918us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830556.896102:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788830556.896119:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595151744 00000100:00100000:3.0:1788830556.896122:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595151744 00000100:00100000:3.0:1788830556.896146:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1788830556.896152:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25474a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+19:3308:x1875724595151744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788830556.896191:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25474a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+19:3308:x1875724595151744:12345-0@lo:400:kworker.0 Request processed in 39us (1098us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830556.896197:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00080000:3.0:1788830556.896233:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788830556.896238:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788830556.896262:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25479a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1745cc3d-3952-4cd4-9020-9b8acb483105:3308:1875724595151744:0@lo:400:kworker.0 00000100:00100000:3.0:1788830556.896276:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2545cbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1875724595152256:0@lo:400:kworker.0 00000100:00100000:3.0:1788830556.896285:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25478b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875724595151872:0@lo:400:kworker.0 00010000:00080000:3.0:1788830556.896296:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e2545cbed80 x1875724595152384/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788830572 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788830556.896306:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2545cbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875724595152384:0@lo:400:kworker.0 00000100:00100000:3.0:1788830556.896338:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2545cbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875724595152128:0@lo:400:kworker.0 00010000:00080000:3.0:1788830556.896348:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e25478b6d80 x1875724595152000/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788830572 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788830556.896357:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25478b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875724595152000:0@lo:400:kworker.0 00010000:00010000:3.0:1788830557.214037:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788830557.407782:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e255005dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875724595152512:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788830557.407849:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788830557.407929:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595152512 00000100:00100000:2.0:1788830557.407937:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595152512 00000100:00100000:2.0:1788830557.407982:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788830557.407991:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255005fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875724595152512:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788830557.408036:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788830557.408079:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255005fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875724595152512:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830557.408087:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:2.0:1788830557.408135:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e255005dc00 x1875724595152512/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788830573 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788830557.408159:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e255005dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875724595152512:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788830558.237613:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788830558.579433:0:11359:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg121-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788830559.259916:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788830560.283829:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788830560.988343:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e255005dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875724595152640:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788830560.988427:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788830560.988546:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595152640 00000100:00100000:2.0:1788830560.988563:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595152640 00000100:00100000:2.0:1788830560.988631:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788830560.988641:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25654ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875724595152640:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788830560.988673:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788830560.988762:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25654ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875724595152640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 123us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830560.988769:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:3.0:1788830560.989350:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e255005dc00 x1875724595152640/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788830576 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788830560.989389:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e255005dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875724595152640:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788830560.992982:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788830561.308867:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788830561.672509:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830561.672545:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830561.672590:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830561.672652:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578340864 00000100:00100000:3.0:1788830561.672662:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578340864 00000100:00100000:3.0:1788830561.672760:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578340992 00000100:00100000:3.0:1788830561.672765:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578340992 00000100:00100000:3.0:1788830561.672786:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 84 00000100:00100000:3.0:1788830561.672794:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25472fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+6:2354:x1875724578340864:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:3.0:1788830561.672864:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25472fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+6:2354:x1875724578340864:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 69us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830561.672872:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 84 00000100:00100000:3.0:1788830561.672887:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 85 00000100:00100000:3.0:1788830561.672891:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25472fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2154ea6-69cb-4a30-aac0-000fba13e98b+5:2354:x1875724578340992:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:3.0:1788830561.672908:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25472fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2154ea6-69cb-4a30-aac0-000fba13e98b+5:2354:x1875724578340992:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 17us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830561.672912:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 85 00000100:00080000:1.0:1788830561.673232:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788830561.673345:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578340736 00000100:00100000:2.0:1788830561.673350:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578340736 00000100:00100000:2.0:1788830561.673389:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 244 00000100:00100000:2.0:1788830561.673396:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25474aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+13:2354:x1875724578340736:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:2.0:1788830561.673438:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25474aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+13:2354:x1875724578340736:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 42us (890us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830561.673444:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 244 00000100:00100000:0.0:1788830562.024809:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2547240380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1745cc3d-3952-4cd4-9020-9b8acb483105:3307:1875724595152768:0@lo:400:kworker.0 00000100:00100000:0.0:1788830562.024891:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830562.024939:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2551308700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1875724595153280:0@lo:400:kworker.0 00000100:00100000:0.0:1788830562.024967:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830562.024996:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788830562.025003:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2547242300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875724595152896:0@lo:400:kworker.0 00000100:00100000:0.0:1788830562.025035:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830562.025052:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2551309880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875724595153408:0@lo:400:kworker.0 00000100:00100000:0.0:1788830562.025075:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830562.025108:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e244599b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875724595153024:0@lo:400:kworker.0 00000100:00100000:0.0:1788830562.025130:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830562.025149:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788830562.025154:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e244599a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875724595153152:0@lo:400:kworker.0 00000100:00100000:0.0:1788830562.025176:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830562.025210:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595152768 00000100:00100000:0.0:1788830562.025217:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595152768 00000100:00100000:0.0:1788830562.025267:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1788830562.025276:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25474ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1745cc3d-3952-4cd4-9020-9b8acb483105+19:3307:x1875724595152768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788830562.025325:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25474ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1745cc3d-3952-4cd4-9020-9b8acb483105+19:3307:x1875724595152768:12345-0@lo:400:kworker.0 Request processed in 50us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830562.025332:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1788830562.025364:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595153280 00000100:00100000:0.0:1788830562.025368:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595153280 00000100:00100000:0.0:1788830562.025403:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595152896 00000100:00100000:0.0:1788830562.025405:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595152896 00000100:00100000:0.0:1788830562.025415:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595153152 00000100:00100000:0.0:1788830562.025417:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595153152 00000100:00100000:0.0:1788830562.025430:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788830562.025435:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2551309180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875724595153280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788830562.025466:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2551309180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875724595153280:12345-0@lo:400:kworker.0 Request processed in 31us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830562.025472:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788830562.025484:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788830562.025496:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255130b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875724595152896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788830562.025526:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255130b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875724595152896:12345-0@lo:400:kworker.0 Request processed in 30us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830562.025531:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788830562.025544:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788830562.025550:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2551308000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875724595153152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788830562.025579:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2551308000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875724595153152:12345-0@lo:400:kworker.0 Request processed in 29us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830562.025584:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788830562.025604:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595153408 00000100:00100000:0.0:1788830562.025608:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595153408 00000100:00100000:0.0:1788830562.025633:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595153024 00000100:00100000:0.0:1788830562.025636:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595153024 00000100:00100000:0.0:1788830562.025650:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788830562.025656:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2551308380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875724595153408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788830562.025696:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2551308380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875724595153408:12345-0@lo:400:kworker.0 Request processed in 40us (620us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830562.025701:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788830562.025736:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788830562.025743:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255130a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875724595153024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788830562.025768:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255130a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875724595153024:12345-0@lo:400:kworker.0 Request processed in 26us (638us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830562.025774:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:0.0:1788830562.025798:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788830562.025802:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788830562.025804:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788830562.025835:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e244599a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875724595153152:0@lo:400:kworker.0 00010000:00080000:0.0:1788830562.025855:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e244599b800 x1875724595153024/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788830578 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788830562.025866:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e244599b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875724595153024:0@lo:400:kworker.0 00000100:00100000:0.0:1788830562.025894:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2547242300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875724595152896:0@lo:400:kworker.0 00010000:00080000:0.0:1788830562.025904:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e2551309880 x1875724595153408/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788830578 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788830562.025913:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2551309880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875724595153408:0@lo:400:kworker.0 00000100:00100000:0.0:1788830562.025920:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2547240380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1745cc3d-3952-4cd4-9020-9b8acb483105:3307:1875724595152768:0@lo:400:kworker.0 00000100:00100000:0.0:1788830562.025928:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2551308700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1875724595153280:0@lo:400:kworker.0 00000001:02000400:0.0:1788830562.284120:0:11458:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 21:22:40 (1788830560) === 00010000:00010000:0.0:1788830562.336996:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788830562.529195:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788830562.529219:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25472ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875724595153536:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788830562.529287:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830562.529383:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595153536 00000100:00100000:1.0:1788830562.529392:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595153536 00000100:00100000:1.0:1788830562.529455:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788830562.529465:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25654e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875724595153536:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788830562.529498:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788830562.529552:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25654e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875724595153536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830562.529559:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:3.0:1788830562.531220:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e25472ff480 x1875724595153536/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788830578 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788830562.531247:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25472ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875724595153536:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788830562.710924:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830562.710977:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830562.711143:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578341248 00000100:00100000:2.0:1788830562.711152:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578341248 00000100:00100000:2.0:1788830562.711213:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 0 00000100:00100000:2.0:1788830562.711223:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25472fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+6:9674:x1875724578341248:12345-192.168.201.21@tcp:700:mkdir.0 00000100:00100000:2.0:1788830562.711308:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25472fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+6:9674:x1875724578341248:12345-192.168.201.21@tcp:700:mkdir.0 Request processed in 86us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830562.711315:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 0 00000100:00100000:0.0:1788830562.711743:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578341120 00000100:00100000:0.0:1788830562.711749:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578341120 00000100:00100000:0.0:1788830562.711790:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 14 00000100:00100000:0.0:1788830562.711797:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25472ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+6:2354:x1875724578341120:12345-192.168.201.21@tcp:41:mkdir.0 00000004:00000024:0.0:1788830562.711839:0:5833:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788830562.711948:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25472ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+6:2354:x1875724578341120:12345-192.168.201.21@tcp:41:mkdir.0 Request processed in 151us (1035us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830562.711954:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 14 00000100:00100000:1.0:1788830562.726378:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830562.727361:0:8202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578341504 00000100:00100000:0.0:1788830562.727374:0:8202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578341504 00000100:00100000:0.0:1788830562.727460:0:8202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 15 00000100:00100000:0.0:1788830562.727483:0:8202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25472fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+6:9674:x1875724578341504:12345-192.168.201.21@tcp:36:mkdir.0 00010000:00010000:0.0:1788830562.727566:0:8202:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788830562.727640:0:8202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea0ae8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661be7 expref: 6 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830562.727662:0:8202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e257480c100) 00010000:00010000:0.0:1788830562.727684:0:8202:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788830562.728079:0:8202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7fc00/0x575506951eea0c07 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830562.728093:0:8202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7fc00/0x575506951eea0c07 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830562.728104:0:8202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7fc00/0x575506951eea0c07 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830562.728134:0:8202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea0c0e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830562.728142:0:8202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea0c0e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830562.728149:0:8202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea0c0e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788830562.734745:0:8202:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788830562.734766:0:8202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7fc00/0x575506951eea0c07 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830562.734777:0:8202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7fc00/0x575506951eea0c07 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830562.734784:0:8202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7fc00/0x575506951eea0c07 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830562.734798:0:8202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2445b7fc00 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:0.0:1788830562.734803:0:8202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7fc00/0x575506951eea0c07 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830562.734811:0:8202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7fc00/0x575506951eea0c07 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830562.734843:0:8202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e25518dc500) 00010000:00010000:0.0:1788830562.734846:0:8202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788830562.734851:0:8202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7fc00/0x575506951eea0c07 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830562.734858:0:8202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7fc00/0x575506951eea0c07 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788830562.734879:0:8202:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000069a4483c reply state 00000000e285be66 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea0c0e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788830562.734888:0:8202:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788830562.741554:0:8202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25472fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+7:9674:x1875724578341504:12345-192.168.201.21@tcp:36:mkdir.0 Request processed in 14063us (15176us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1788830562.741569:0:8202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 15 00010000:00010000:3.0:1788830562.748134:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea0c0e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830562.748169:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea0c0e lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830562.748177:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea0c0e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830562.748183:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2445b7f800 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:3.0:1788830562.748188:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea0c0e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830562.748207:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea0c0e lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830562.748224:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9e25518dc900) 00010000:00010000:3.0:1788830562.748228:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788830562.748233:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea0c0e lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830562.748239:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea0c0e lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788830562.770910:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830562.771077:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578341632 00000100:00100000:0.0:1788830562.771090:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578341632 00000100:00100000:0.0:1788830562.771157:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 16 00000100:00100000:0.0:1788830562.771169:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25472fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+6:9676:x1875724578341632:12345-192.168.201.21@tcp:101:chmod.0 00010000:00010000:0.0:1788830562.771204:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788830562.771232:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7fc00/0x575506951eea0c15 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa578910534661c6c expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830562.771335:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ec00/0x575506951eea0c1c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830562.771350:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ec00/0x575506951eea0c1c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830562.771362:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ec00/0x575506951eea0c1c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788830562.771403:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788830562.771408:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788830562.771447:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ec00/0x575506951eea0c1c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830562.771476:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7fc00/0x575506951eea0c15 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661c6c expref: 8 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830562.771496:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ec00/0x575506951eea0c1c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661c6c expref: 7 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830562.771506:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e25518dc500) 00010000:00010000:0.0:1788830562.771509:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788830562.771514:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2445b7ec00, rc 0) 00000100:00100000:0.0:1788830562.771586:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25472fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+7:9676:x1875724578341632:12345-192.168.201.21@tcp:101:chmod.0 Request processed in 419us (685us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830562.771593:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 16 00000100:00100000:1.0:1788830562.777923:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830562.778047:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578341888 00000100:00100000:3.0:1788830562.778060:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578341888 00000100:00100000:3.0:1788830562.778160:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 17 00000100:00100000:3.0:1788830562.778172:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25472ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+7:9676:x1875724578341888:12345-192.168.201.21@tcp:36:chmod.0 00010000:00010000:3.0:1788830562.778238:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788830562.778269:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ec00/0x575506951eea0c1c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661c6c expref: 7 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830562.778308:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e25518dc500) 00010000:00010000:3.0:1788830562.778321:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788830562.778348:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944400/0x575506951eea0c23 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830562.778364:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944400/0x575506951eea0c23 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830562.778375:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944400/0x575506951eea0c23 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788830562.779378:0:5832:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f910339f reply state 0000000017e2805e transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944400/0x575506951eea0c23 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788830562.779394:0:5832:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788830562.779410:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1788830562.779910:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25472ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+8:9676:x1875724578341888:12345-192.168.201.21@tcp:36:chmod.0 Request processed in 1735us (1994us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1788830562.779919:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 17 00010000:00010000:0.0:1788830562.791435:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944400/0x575506951eea0c23 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830562.791477:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944400/0x575506951eea0c23 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830562.791486:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944400/0x575506951eea0c23 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830562.791493:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e257d944400 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:0.0:1788830562.791498:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944400/0x575506951eea0c23 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830562.791506:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944400/0x575506951eea0c23 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830562.791523:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e25530b0a00) 00010000:00010000:0.0:1788830562.791527:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788830562.791532:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944400/0x575506951eea0c23 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830562.791538:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944400/0x575506951eea0c23 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788830562.821061:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830562.821177:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578342016 00000100:00100000:0.0:1788830562.821187:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578342016 00000100:00100000:0.0:1788830562.821352:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 18 00000100:00100000:0.0:1788830562.821363:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257fa67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+7:9677:x1875724578342016:12345-192.168.201.21@tcp:101:chown.0 00010000:00010000:0.0:1788830562.821388:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788830562.821412:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7fc00/0x575506951eea0c2a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa578910534661c73 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830562.821497:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e400/0x575506951eea0c31 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830562.821519:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e400/0x575506951eea0c31 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830562.821531:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e400/0x575506951eea0c31 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788830562.821575:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788830562.821579:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788830562.821616:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e400/0x575506951eea0c31 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830562.821645:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7fc00/0x575506951eea0c2a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661c73 expref: 9 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830562.821663:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e400/0x575506951eea0c31 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661c73 expref: 8 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830562.821682:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e25518dca00) 00010000:00010000:0.0:1788830562.821685:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788830562.821688:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2445b7e400, rc 0) 00000100:00100000:0.0:1788830562.821804:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257fa67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+8:9677:x1875724578342016:12345-192.168.201.21@tcp:101:chown.0 Request processed in 442us (752us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830562.821816:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 18 00000100:00100000:1.0:1788830562.828389:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830562.831327:0:8202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578342144 00000100:00100000:0.0:1788830562.831350:0:8202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578342144 00000100:00100000:1.0:1788830562.831842:0:8202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 19 00000100:00100000:1.0:1788830562.831854:0:8202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257fa65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+8:9677:x1875724578342144:12345-192.168.201.21@tcp:101:chown.0 00010000:00010000:1.0:1788830562.831882:0:8202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788830562.831905:0:8202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe800/0x575506951eea0c38 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa578910534661c7a expref: -99 pid: 8202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830562.831975:0:8202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea0c3f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830562.831992:0:8202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea0c3f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830562.832004:0:8202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea0c3f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830562.832019:0:8202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea0c46 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830562.832028:0:8202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea0c46 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830562.832035:0:8202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea0c46 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830562.832130:0:8202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff400/0x575506951eea0c4d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830562.832139:0:8202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff400/0x575506951eea0c4d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830562.832147:0:8202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff400/0x575506951eea0c4d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788830562.832216:0:8202:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788830562.832221:0:8202:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788830562.832243:0:8202:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff400/0x575506951eea0c4d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830562.832254:0:8202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea0c3f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830562.832260:0:8202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea0c3f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830562.832266:0:8202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea0c3f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830562.832272:0:8202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e25820fe400 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:1.0:1788830562.832275:0:8202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea0c3f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830562.832282:0:8202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea0c3f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830562.832294:0:8202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e25518dca00) 00010000:00010000:1.0:1788830562.832297:0:8202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788830562.832301:0:8202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea0c3f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830562.832306:0:8202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea0c3f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830562.832319:0:8202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea0c46 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830562.832335:0:8202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea0c46 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830562.832341:0:8202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea0c46 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830562.832346:0:8202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e25820ff800 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:1.0:1788830562.832349:0:8202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea0c46 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830562.832355:0:8202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea0c46 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830562.832375:0:8202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9e257480c100) 00010000:00010000:1.0:1788830562.832378:0:8202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788830562.832380:0:8202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea0c46 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830562.832386:0:8202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea0c46 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830562.832421:0:8202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe800/0x575506951eea0c38 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661c7a expref: 10 pid: 8202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830562.832433:0:8202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff400/0x575506951eea0c4d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661c7a expref: 9 pid: 8202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830562.832441:0:8202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9e257480ca00) 00010000:00010000:1.0:1788830562.832443:0:8202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788830562.832452:0:8202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e25820ff400, rc 0) 00000100:00100000:1.0:1788830562.832539:0:8202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257fa65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+9:9677:x1875724578342144:12345-192.168.201.21@tcp:101:chown.0 Request processed in 686us (4161us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830562.832554:0:8202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 19 00000100:00100000:1.0:1788830562.839604:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830562.840003:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578342400 00000100:00100000:3.0:1788830562.840013:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578342400 00000100:00100000:3.0:1788830562.840119:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 20 00000100:00100000:3.0:1788830562.840130:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257fa64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+9:9677:x1875724578342400:12345-192.168.201.21@tcp:36:chown.0 00010000:00010000:3.0:1788830562.840184:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788830562.840302:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff400/0x575506951eea0c4d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661c7a expref: 9 pid: 8202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830562.840325:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9e257480ca00) 00010000:00010000:3.0:1788830562.840353:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788830562.840450:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944200/0x575506951eea0c54 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830562.840463:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944200/0x575506951eea0c54 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830562.840789:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944200/0x575506951eea0c54 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788830562.891143:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00000001:00080000:2.0:1788830562.891164:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:0.0:1788830562.891312:0:5834:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005497fe41 reply state 00000000a71a705e transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944200/0x575506951eea0c54 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788830562.891325:0:5834:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788830562.891352:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00080000:0.0:1788830562.891738:0:5834:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1788830562.891755:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257fa64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+7:9677:x1875724578342400:12345-192.168.201.21@tcp:36:chown.0 Request processed in 51623us (52156us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1788830562.891764:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 20 00010000:00010000:3.0:1788830562.891894:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944200/0x575506951eea0c54 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830562.891904:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944200/0x575506951eea0c54 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830562.891911:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944200/0x575506951eea0c54 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830562.891917:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e257d944200 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:3.0:1788830562.891922:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944200/0x575506951eea0c54 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830562.891929:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944200/0x575506951eea0c54 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830562.891944:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9e25530b0300) 00010000:00010000:3.0:1788830562.891947:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788830562.891952:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944200/0x575506951eea0c54 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830562.891958:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944200/0x575506951eea0c54 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788830562.915262:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830562.915351:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578342528 00000100:00100000:3.0:1788830562.915362:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578342528 00000100:00100000:3.0:1788830562.915416:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 21 00000100:00100000:3.0:1788830562.915425:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257fa64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+6:9678:x1875724578342528:12345-192.168.201.21@tcp:101:touch.500 00010000:00010000:3.0:1788830562.915449:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788830562.915469:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944200/0x575506951eea0c5b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa578910534661c81 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788830562.923278:0:5832:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 7760us 00010000:00010000:2.0:1788830562.947365:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729800/0x575506951eea0c62 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830562.947389:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729800/0x575506951eea0c62 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830562.947403:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729800/0x575506951eea0c62 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830562.947417:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729600/0x575506951eea0c69 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830562.947425:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729600/0x575506951eea0c69 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830562.947432:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729600/0x575506951eea0c69 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830562.948037:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729000/0x575506951eea0c70 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830562.948046:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729000/0x575506951eea0c70 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830562.948053:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729000/0x575506951eea0c70 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788830562.948078:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788830562.948082:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788830562.948117:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729000/0x575506951eea0c70 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830562.948140:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729800/0x575506951eea0c62 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830562.948146:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729800/0x575506951eea0c62 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830562.948152:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729800/0x575506951eea0c62 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830562.948159:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2565729800 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:2.0:1788830562.948163:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729800/0x575506951eea0c62 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830562.948171:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729800/0x575506951eea0c62 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830562.948184:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e25518dca00) 00010000:00010000:2.0:1788830562.948187:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788830562.948191:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729800/0x575506951eea0c62 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830562.948197:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729800/0x575506951eea0c62 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830562.948208:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729600/0x575506951eea0c69 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830562.948213:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729600/0x575506951eea0c69 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830562.948219:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729600/0x575506951eea0c69 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830562.948230:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2565729600 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:2.0:1788830562.948233:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729600/0x575506951eea0c69 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830562.948240:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729600/0x575506951eea0c69 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830562.948248:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9e2551f3e100) 00010000:00010000:2.0:1788830562.948250:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788830562.948252:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729600/0x575506951eea0c69 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830562.948258:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729600/0x575506951eea0c69 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830562.948295:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944200/0x575506951eea0c5b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661c81 expref: 8 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830562.948311:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729000/0x575506951eea0c70 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661c81 expref: 7 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830562.948318:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9e2551f3ee00) 00010000:00010000:2.0:1788830562.948321:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788830562.948323:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2565729000, rc 0) 00000100:00100000:2.0:1788830562.948967:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257fa64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+7:9678:x1875724578342528:12345-192.168.201.21@tcp:101:touch.500 Request processed in 33539us (33710us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830562.948978:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 21 00000100:00100000:2.0:1788830562.962159:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830562.962424:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578342784 00000100:00100000:0.0:1788830562.962435:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578342784 00000100:00100000:1.0:1788830562.962970:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 22 00000100:00100000:1.0:1788830562.962984:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255005d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+7:9678:x1875724578342784:12345-192.168.201.21@tcp:101:touch.500 00010000:00010000:1.0:1788830562.963004:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788830562.963023:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe800/0x575506951eea0c77 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa578910534661c88 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830562.963265:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea0c7e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830562.963280:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea0c7e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830562.963292:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea0c7e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830562.963354:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea0c85 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x9a0eeda8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830562.963362:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea0c85 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x9a0eeda8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830562.963368:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea0c85 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x9a0eeda8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788830562.964300:0:5833:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:1.0:1788830562.964579:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff400/0x575506951eea0c8c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830562.964592:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff400/0x575506951eea0c8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830562.964600:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff400/0x575506951eea0c8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830562.964640:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea0c7e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830562.964647:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea0c7e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830562.964653:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea0c7e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830562.964659:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e25820ff800 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:1.0:1788830562.964663:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea0c7e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830562.964681:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea0c7e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830562.964693:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9e2551f3ee00) 00010000:00010000:1.0:1788830562.964697:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788830562.964702:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea0c7e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830562.965068:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea0c7e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788830562.965094:0:5833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008f0614eb reply state 000000008022770c transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea0c85 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x9a0eeda8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788830562.965102:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788830562.965138:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe800/0x575506951eea0c77 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661c88 expref: 10 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830562.965153:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff400/0x575506951eea0c8c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661c88 expref: 9 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830562.965161:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9e257480c400) 00010000:00010000:1.0:1788830562.965163:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788830562.965165:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e25820ff400, rc 0) 00000100:00100000:1.0:1788830562.965278:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255005d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+10:9678:x1875724578342784:12345-192.168.201.21@tcp:101:touch.500 Request processed in 2297us (3127us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1788830562.965286:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 22 00010000:00010000:0.0:1788830562.969146:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea0c85 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x9a0eeda8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830562.969164:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea0c85 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x9a0eeda8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830562.969172:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea0c85 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x9a0eeda8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830562.969178:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e25820fe400 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:0.0:1788830562.969183:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea0c85 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x9a0eeda8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830562.969190:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea0c85 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x9a0eeda8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830562.969210:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x9a0eeda8 (ffff9e257480c100) 00010000:00010000:0.0:1788830562.969212:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788830562.969217:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea0c85 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x9a0eeda8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830562.969223:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea0c85 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x9a0eeda8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788830562.972225:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830562.972315:0:8202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578343040 00000100:00100000:1.0:1788830562.972325:0:8202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578343040 00000100:00100000:1.0:1788830562.972389:0:8202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 23 00000100:00100000:1.0:1788830562.972399:0:8202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255005e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+9:9678:x1875724578343040:12345-192.168.201.21@tcp:36:touch.500 00010000:00010000:1.0:1788830562.972455:0:8202:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788830562.972478:0:8202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff400/0x575506951eea0c8c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661c88 expref: 9 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830562.972495:0:8202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9e257480c400) 00010000:00010000:1.0:1788830562.972505:0:8202:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788830562.972566:0:8202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2540030a00/0x575506951eea0c9a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830562.972580:0:8202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2540030a00/0x575506951eea0c9a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830562.972590:0:8202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2540030a00/0x575506951eea0c9a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788830562.972763:0:8202:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000c73d1ce reply state 00000000277140dd transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2540030a00/0x575506951eea0c9a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788830562.972773:0:8202:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788830562.972870:0:8202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255005e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+10:9678:x1875724578343040:12345-192.168.201.21@tcp:36:touch.500 Request processed in 471us (655us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1788830562.972878:0:8202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 23 00010000:00010000:2.0:1788830562.976226:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2540030a00/0x575506951eea0c9a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830562.976244:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2540030a00/0x575506951eea0c9a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830562.976253:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2540030a00/0x575506951eea0c9a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830562.976260:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2540030a00 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:2.0:1788830562.976265:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2540030a00/0x575506951eea0c9a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830562.976273:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2540030a00/0x575506951eea0c9a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830562.976291:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9e257480c200) 00010000:00010000:2.0:1788830562.976294:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788830562.976300:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2540030a00/0x575506951eea0c9a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830562.976305:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2540030a00/0x575506951eea0c9a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788830562.977263:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830562.977588:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578343168 00000100:00100000:3.0:1788830562.977598:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578343168 00000100:00100000:3.0:1788830562.977647:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 24 00000100:00100000:3.0:1788830562.977654:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255005dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+9:9678:x1875724578343168:12345-192.168.201.21@tcp:101:touch.500 00010000:00010000:3.0:1788830562.977687:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788830562.977749:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944800/0x575506951eea0ca1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa578910534661c8f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830562.977868:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944800/0x575506951eea0ca1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661c8f expref: 10 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830562.977878:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944800/0x575506951eea0ca1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661c8f expref: 10 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830562.977893:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9e25530b0300) 00010000:00010000:3.0:1788830562.977897:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788830562.977912:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e257d944800, rc 0) 00000100:00100000:3.0:1788830562.977970:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255005dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+10:9678:x1875724578343168:12345-192.168.201.21@tcp:101:touch.500 Request processed in 315us (712us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830562.977978:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 24 00000100:00100000:3.0:1788830562.980878:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830562.984232:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578343296 00000100:00100000:0.0:1788830562.984264:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578343296 00000100:00100000:0.0:1788830562.984331:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 18 00000100:00100000:0.0:1788830562.984341:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25654e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2351:x1875724578343296:12345-192.168.201.21@tcp:8:touch.500 00010000:00080000:0.0:1788830562.984372:0:6677:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 1ef2fe7a-e5ec-4085-8326-b72aa00876cd@192.168.201.21@tcp t0 exp 0000000000000000 cur 316 last 0 00000020:00000080:0.0:1788830562.984406:0:6677:0:(genops.c:1385:class_connect()) connect: client 1ef2fe7a-e5ec-4085-8326-b72aa00876cd, cookie 0x575506951eea0ca8 00002000:00100000:0.0:1788830562.984418:0:6677:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 1ef2fe7a-e5ec-4085-8326-b72aa00876cd/ffff9e2547358000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113968 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788830562.984441:0:6677:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788830562.984749:0:6677:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788830562.984784:0:6677:0:(import.c:65:import_set_state_nolock()) ffff9e2547358800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788830562.984857:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25654e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+6:2351:x1875724578343296:12345-192.168.201.21@tcp:8:touch.500 Request processed in 515us (3988us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830562.984865:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 18 00000100:00100000:2.0:1788830563.005603:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830563.005771:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578343424 00000100:00100000:0.0:1788830563.005783:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578343424 00000100:00100000:0.0:1788830563.005856:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 19 00000100:00100000:0.0:1788830563.005867:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255005ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+6:0:x1875724578343424:12345-192.168.201.21@tcp:2:touch.500 00000100:00080000:1.0:1788830563.006240:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788830563.047415:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255005ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+7:0:x1875724578343424:12345-192.168.201.21@tcp:2:touch.500 Request processed in 41539us (41811us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1788830563.047428:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 19 00000001:00080000:3.0:1788830563.048401:0:6709:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000001:00100000:3.0:1788830563.048414:0:6709:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 1ef2fe7a-e5ec-4085-8326-b72aa00876cd 00000100:00100000:2.0:1788830563.055426:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830563.056595:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578343680 00000100:00100000:0.0:1788830563.056609:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578343680 00000100:00100000:0.0:1788830563.056766:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 2 00000100:00100000:0.0:1788830563.056780:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255005c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+10:9678:x1875724578343680:12345-192.168.201.21@tcp:35:touch.500 00000100:00100000:0.0:1788830563.057160:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255005c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+11:9678:x1875724578343680:12345-192.168.201.21@tcp:35:touch.500 Request processed in 382us (1741us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1788830563.057182:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 2 00000100:00080000:1.0:1788830563.058800:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788830563.077651:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830563.080782:0:8202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578343808 00000100:00100000:3.0:1788830563.080798:0:8202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578343808 00000100:00100000:3.0:1788830563.081382:0:8202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 25 00000100:00100000:3.0:1788830563.081394:0:8202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257fa66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+11:9679:x1875724578343808:12345-192.168.201.21@tcp:101:rm.0 00010000:00010000:3.0:1788830563.081418:0:8202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788830563.081437:0:8202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945200/0x575506951eea0caf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa578910534661c96 expref: -99 pid: 8202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830563.081502:0:8202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945400/0x575506951eea0cb6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830563.081516:0:8202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945400/0x575506951eea0cb6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830563.081527:0:8202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945400/0x575506951eea0cb6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788830563.081572:0:8202:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788830563.081576:0:8202:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788830563.081614:0:8202:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945400/0x575506951eea0cb6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830563.081641:0:8202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945200/0x575506951eea0caf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661c96 expref: 13 pid: 8202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830563.081684:0:8202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945400/0x575506951eea0cb6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661c96 expref: 12 pid: 8202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830563.081693:0:8202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9e2551f3ee00) 00010000:00010000:3.0:1788830563.081696:0:8202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788830563.081699:0:8202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e257d945400, rc 0) 00000100:00100000:3.0:1788830563.081797:0:8202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257fa66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+12:9679:x1875724578343808:12345-192.168.201.21@tcp:101:rm.0 Request processed in 406us (4155us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830563.081804:0:8202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 25 00000100:00100000:0.0:1788830563.101430:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830563.108269:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578344064 00000100:00100000:1.0:1788830563.108284:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578344064 00000100:00100000:1.0:1788830563.108394:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 26 00000100:00100000:1.0:1788830563.108405:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2551308700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+12:9679:x1875724578344064:12345-192.168.201.21@tcp:101:rm.0 00010000:00010000:1.0:1788830563.108424:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788830563.108445:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2540031200/0x575506951eea0cbd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa578910534661c9d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788830563.108529:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1788830563.108730:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2540031200/0x575506951eea0cbd lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661c9d expref: 14 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830563.108755:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e25518dca00) 00010000:00010000:1.0:1788830563.108758:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788830563.108763:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2540031200/0x575506951eea0cbd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661c9d expref: 14 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830563.108780:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2540031200, rc 0) 00000100:00100000:1.0:1788830563.108873:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2551308700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+13:9679:x1875724578344064:12345-192.168.201.21@tcp:101:rm.0 Request processed in 468us (7451us total) trans 4294967303 rc 301/301 00000100:00100000:1.0:1788830563.108880:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 26 00000100:00100000:1.0:1788830563.118103:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830563.118340:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578344192 00000100:00100000:0.0:1788830563.118351:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578344192 00000100:00100000:0.0:1788830563.118414:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 3 00000100:00100000:0.0:1788830563.118424:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257fa64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+13:9679:x1875724578344192:12345-192.168.201.21@tcp:37:rm.0 00000100:00100000:0.0:1788830563.123629:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257fa64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+13:9679:x1875724578344192:12345-192.168.201.21@tcp:37:rm.0 Request processed in 5194us (5523us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830563.123645:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 3 00000100:00100000:3.0:1788830563.138005:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830563.138301:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578344448 00000100:00100000:1.0:1788830563.138312:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578344448 00000100:00100000:1.0:1788830563.138374:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 4 00000100:00100000:1.0:1788830563.138386:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25629b0c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+13:9679:x1875724578344448:12345-192.168.201.21@tcp:35:rm.0 00000100:00100000:1.0:1788830563.138634:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25629b0c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+14:9679:x1875724578344448:12345-192.168.201.21@tcp:35:rm.0 Request processed in 250us (637us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1788830563.138642:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 4 00000100:00100000:1.0:1788830563.143559:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830563.143653:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578344704 00000100:00100000:2.0:1788830563.143675:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578344704 00000100:00100000:1.0:1788830563.144020:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 27 00000100:00100000:1.0:1788830563.144033:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257fa64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+14:9679:x1875724578344704:12345-192.168.201.21@tcp:101:rm.0 00010000:00010000:1.0:1788830563.144059:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788830563.144082:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2540030600/0x575506951eea0ccb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa578910534661ca4 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830563.144199:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2540031200/0x575506951eea0cd2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830563.144214:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2540031200/0x575506951eea0cd2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830563.144225:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2540031200/0x575506951eea0cd2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788830563.144235:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1788830563.144536:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2540030600/0x575506951eea0ccb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661ca4 expref: 17 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830563.144570:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2540031200/0x575506951eea0cd2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661ca4 expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830563.144579:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9e2551f3ee00) 00010000:00010000:1.0:1788830563.144582:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788830563.144586:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2540031200, rc 0) 00000100:00100000:1.0:1788830563.144654:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257fa64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+16:9679:x1875724578344704:12345-192.168.201.21@tcp:101:rm.0 Request processed in 624us (1102us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1788830563.144671:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 27 00000100:00100000:1.0:1788830563.148609:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830563.148919:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578344832 00000100:00100000:3.0:1788830563.148929:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578344832 00000100:00100000:3.0:1788830563.148988:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 28 00000100:00100000:3.0:1788830563.148999:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257fa64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+16:9679:x1875724578344832:12345-192.168.201.21@tcp:41:rm.0 00000004:00000024:3.0:1788830563.149058:0:5833:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:3.0:1788830563.149160:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257fa64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+16:9679:x1875724578344832:12345-192.168.201.21@tcp:41:rm.0 Request processed in 162us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830563.149169:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 28 00000100:00100000:0.0:1788830563.159576:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830563.160011:0:8202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578344960 00000100:00100000:3.0:1788830563.160022:0:8202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578344960 00000100:00100000:3.0:1788830563.160081:0:8202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 29 00000100:00100000:3.0:1788830563.160092:0:8202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2551309880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+16:9679:x1875724578344960:12345-192.168.201.21@tcp:101:rm.0 00010000:00010000:3.0:1788830563.160114:0:8202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788830563.160136:0:8202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945200/0x575506951eea0ce0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa578910534661cab expref: -99 pid: 8202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830563.160222:0:8202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945c00/0x575506951eea0ce7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830563.160237:0:8202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945c00/0x575506951eea0ce7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830563.160260:0:8202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945c00/0x575506951eea0ce7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830563.160276:0:8202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944200/0x575506951eea0cee lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x9a0eeda8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830563.160283:0:8202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944200/0x575506951eea0cee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x9a0eeda8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830563.160289:0:8202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944200/0x575506951eea0cee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x9a0eeda8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830563.160619:0:8202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944400/0x575506951eea0cf5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830563.160629:0:8202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944400/0x575506951eea0cf5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830563.160636:0:8202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944400/0x575506951eea0cf5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788830563.160675:0:8202:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:3.0:1788830563.160680:0:8202:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788830563.160972:0:8202:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944400/0x575506951eea0cf5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830563.160998:0:8202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944400/0x575506951eea0cf5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830563.161006:0:8202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945c00/0x575506951eea0ce7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830563.161012:0:8202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945c00/0x575506951eea0ce7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830563.161019:0:8202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945c00/0x575506951eea0ce7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830563.161024:0:8202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e257d945c00 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:3.0:1788830563.161027:0:8202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945c00/0x575506951eea0ce7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830563.161035:0:8202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945c00/0x575506951eea0ce7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830563.161047:0:8202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9e2551f3ee00) 00010000:00010000:3.0:1788830563.161050:0:8202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788830563.161054:0:8202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945c00/0x575506951eea0ce7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830563.161059:0:8202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945c00/0x575506951eea0ce7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830563.161073:0:8202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944200/0x575506951eea0cee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x9a0eeda8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830563.161079:0:8202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944200/0x575506951eea0cee lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x9a0eeda8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830563.161090:0:8202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944200/0x575506951eea0cee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x9a0eeda8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830563.161094:0:8202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e257d944200 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:3.0:1788830563.161097:0:8202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944200/0x575506951eea0cee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x9a0eeda8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830563.161103:0:8202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944200/0x575506951eea0cee lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x9a0eeda8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830563.161110:0:8202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x9a0eeda8 (ffff9e25530b0600) 00010000:00010000:3.0:1788830563.161113:0:8202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788830563.161115:0:8202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944200/0x575506951eea0cee lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x9a0eeda8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830563.161121:0:8202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944200/0x575506951eea0cee lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x9a0eeda8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830563.161155:0:8202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945200/0x575506951eea0ce0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661cab expref: 18 pid: 8202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830563.161170:0:8202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944400/0x575506951eea0cf5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661cab expref: 17 pid: 8202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830563.161176:0:8202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9e25530b0300) 00010000:00010000:3.0:1788830563.161179:0:8202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788830563.161181:0:8202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e257d944400, rc 0) 00000100:00100000:3.0:1788830563.161503:0:8202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2551309880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+17:9679:x1875724578344960:12345-192.168.201.21@tcp:101:rm.0 Request processed in 1411us (1936us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830563.161520:0:8202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 29 00000100:00100000:0.0:1788830563.175929:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830563.176016:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578345216 00000100:00100000:3.0:1788830563.176027:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578345216 00000100:00100000:3.0:1788830563.176127:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 30 00000100:00100000:3.0:1788830563.176138:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255130bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+17:9679:x1875724578345216:12345-192.168.201.21@tcp:36:rm.0 00010000:00010000:3.0:1788830563.176195:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788830563.176224:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944400/0x575506951eea0cf5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661cab expref: 17 pid: 8202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830563.176256:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944800/0x575506951eea0ca1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661c8f expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830563.176268:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9e25530b0300) 00010000:00010000:3.0:1788830563.176283:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945400/0x575506951eea0cb6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661c96 expref: 15 pid: 8202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830563.176292:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9e2551f3ee00) 00010000:00010000:3.0:1788830563.176296:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788830563.176316:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945200/0x575506951eea0cfc lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830563.176330:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945200/0x575506951eea0cfc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830563.176340:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945200/0x575506951eea0cfc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830563.176355:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944200/0x575506951eea0d03 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x9a0eeda8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830563.176386:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944200/0x575506951eea0d03 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x9a0eeda8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830563.176394:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944200/0x575506951eea0d03 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x9a0eeda8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830563.176529:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945c00/0x575506951eea0d0a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830563.176547:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945c00/0x575506951eea0d0a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830563.176554:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945c00/0x575506951eea0d0a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788830563.177324:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:3.0:1788830563.177335:0:5833:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 316524625346ns, next at 317524623163ns, rc = 0 00010000:00010000:3.0:1788830563.177395:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944a00/0x575506951eea0d11 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830563.177404:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944a00/0x575506951eea0d11 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830563.177413:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944a00/0x575506951eea0d11 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830563.177420:0:5833:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944a00/0x575506951eea0d11 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830563.177427:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944a00/0x575506951eea0d11 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830563.177444:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944a00/0x575506951eea0d11 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830563.177472:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788830563.177493:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945c00/0x575506951eea0d0a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830563.177499:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945c00/0x575506951eea0d0a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830563.177506:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945c00/0x575506951eea0d0a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830563.177512:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e257d945c00 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:3.0:1788830563.177516:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945c00/0x575506951eea0d0a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830563.177522:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945c00/0x575506951eea0d0a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830563.177533:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9e25530b0500) 00010000:00010000:3.0:1788830563.177536:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788830563.177541:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945c00/0x575506951eea0d0a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830563.177546:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945c00/0x575506951eea0d0a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830563.177564:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945200/0x575506951eea0cfc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830563.177569:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945200/0x575506951eea0cfc lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830563.177581:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945200/0x575506951eea0cfc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830563.177586:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e257d945200 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:3.0:1788830563.177590:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945200/0x575506951eea0cfc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830563.177596:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945200/0x575506951eea0cfc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830563.177605:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9e2551f3ee00) 00010000:00010000:3.0:1788830563.177607:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788830563.177610:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945200/0x575506951eea0cfc lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830563.177616:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945200/0x575506951eea0cfc lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788830563.177625:0:5833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001f6e0227 reply state 0000000081cac4d8 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944200/0x575506951eea0d03 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x9a0eeda8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788830563.177633:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788830563.177757:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255130bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+16:9679:x1875724578345216:12345-192.168.201.21@tcp:36:rm.0 Request processed in 1619us (1835us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1788830563.177766:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 30 00010000:00010000:0.0:1788830563.177848:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788830563.177855:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944a00/0x575506951eea0d11 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830563.177861:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e257d944a00 already unused, calling callback (ffffffffc14cb350) 00010000:00010000:0.0:1788830563.177864:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944a00/0x575506951eea0d11 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830563.177870:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944a00/0x575506951eea0d11 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830563.177880:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9e25530b0500) 00010000:00010000:0.0:1788830563.177882:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788830563.177885:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944a00/0x575506951eea0d11 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830563.177891:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944a00/0x575506951eea0d11 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830563.177913:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788830563.177915:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788830563.177917:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788830563.184327:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00010000:00010000:3.0:1788830563.184406:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944200/0x575506951eea0d03 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x9a0eeda8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830563.184419:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944200/0x575506951eea0d03 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x9a0eeda8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830563.184443:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944200/0x575506951eea0d03 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x9a0eeda8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830563.184450:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e257d944200 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:3.0:1788830563.184454:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944200/0x575506951eea0d03 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x9a0eeda8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830563.184462:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944200/0x575506951eea0d03 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x9a0eeda8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830563.184479:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x9a0eeda8 (ffff9e25530b0600) 00010000:00010000:3.0:1788830563.184483:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788830563.184488:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944200/0x575506951eea0d03 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x9a0eeda8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830563.184494:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944200/0x575506951eea0d03 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x9a0eeda8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788830563.185962:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578345472 00000100:00100000:1.0:1788830563.185975:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578345472 00000100:00100000:1.0:1788830563.186039:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 5 00000100:00100000:1.0:1788830563.186049:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255005f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+15:9679:x1875724578345472:12345-192.168.201.21@tcp:35:rm.0 00000100:00100000:1.0:1788830563.186315:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255005f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+16:9679:x1875724578345472:12345-192.168.201.21@tcp:35:rm.0 Request processed in 266us (1999us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1788830563.186324:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 5 00000100:00100000:0.0:1788830563.188897:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830563.189023:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578345728 00000100:00100000:1.0:1788830563.189032:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578345728 00000100:00100000:1.0:1788830563.189088:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 31 00000100:00100000:1.0:1788830563.189098:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2551309c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+16:9679:x1875724578345728:12345-192.168.201.21@tcp:36:rm.0 00010000:00010000:1.0:1788830563.189149:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788830563.189173:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2540031200/0x575506951eea0cd2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661ca4 expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830563.189194:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729000/0x575506951eea0c70 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661c81 expref: 15 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830563.189205:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9e2551f3ee00) 00010000:00010000:1.0:1788830563.189218:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e400/0x575506951eea0c31 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661c73 expref: 14 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830563.189226:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e25518dca00) 00010000:00010000:1.0:1788830563.189232:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788830563.189261:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2540030600/0x575506951eea0d18 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830563.189273:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2540030600/0x575506951eea0d18 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830563.189282:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2540030600/0x575506951eea0d18 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830563.189305:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2540031e00/0x575506951eea0d1f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830563.189312:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2540031e00/0x575506951eea0d1f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830563.189319:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2540031e00/0x575506951eea0d1f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830563.189535:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2540031c00/0x575506951eea0d26 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830563.189553:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2540031c00/0x575506951eea0d26 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830563.189559:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2540031c00/0x575506951eea0d26 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788830563.191080:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1788830563.191101:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2540031c00/0x575506951eea0d26 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830563.191110:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2540031c00/0x575506951eea0d26 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830563.191117:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2540031c00/0x575506951eea0d26 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830563.191123:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2540031c00 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:1.0:1788830563.191127:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2540031c00/0x575506951eea0d26 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830563.191144:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2540031c00/0x575506951eea0d26 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830563.191158:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9e257480c800) 00010000:00010000:1.0:1788830563.191160:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788830563.191164:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2540031c00/0x575506951eea0d26 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830563.191170:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2540031c00/0x575506951eea0d26 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830563.191194:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2540030600/0x575506951eea0d18 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830563.191200:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2540030600/0x575506951eea0d18 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830563.191206:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2540030600/0x575506951eea0d18 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830563.191211:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2540030600 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:1.0:1788830563.191214:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2540030600/0x575506951eea0d18 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830563.191219:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2540030600/0x575506951eea0d18 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830563.191226:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e257480c900) 00010000:00010000:1.0:1788830563.191228:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788830563.191230:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2540030600/0x575506951eea0d18 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830563.191256:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2540030600/0x575506951eea0d18 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788830563.191269:0:5832:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000622becd6 reply state 000000009c1f1ec8 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2540031e00/0x575506951eea0d1f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788830563.191278:0:5832:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788830563.191920:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2551309c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+15:9679:x1875724578345728:12345-192.168.201.21@tcp:36:rm.0 Request processed in 2817us (3025us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1788830563.191930:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 31 00010000:00010000:2.0:1788830563.193569:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2540031e00/0x575506951eea0d1f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830563.193595:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2540031e00/0x575506951eea0d1f lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830563.193601:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2540031e00/0x575506951eea0d1f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830563.193606:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2540031e00 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:2.0:1788830563.193610:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2540031e00/0x575506951eea0d1f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830563.193617:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2540031e00/0x575506951eea0d1f lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830563.193632:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9e257480c400) 00010000:00010000:2.0:1788830563.193635:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788830563.193638:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2540031e00/0x575506951eea0d1f lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830563.193643:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2540031e00/0x575506951eea0d1f lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830563.355938:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788830564.380415:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788830565.403939:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788830566.108116:0:6697:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 319455403571ns, next at 320455401376ns, rc = 0 00000100:00100000:0.0:1788830566.108194:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788830566.108221:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e255005f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875724595153664:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788830566.108302:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788830566.108524:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595153664 00000100:00100000:2.0:1788830566.108532:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595153664 00000100:00100000:2.0:1788830566.108623:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788830566.108634:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2551309500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875724595153664:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788830566.108670:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788830566.108755:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2551309500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875724595153664:12345-0@lo:13:osp-pre-0-0.0 Request processed in 121us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830566.108776:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:1.0:1788830566.108832:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788830566.108946:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e255005f800 x1875724595153664/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788830582 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788830566.108966:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e255005f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875724595153664:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788830566.429514:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788830566.791880:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830566.791923:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830566.791953:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830566.792037:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578345856 00000100:00100000:1.0:1788830566.792047:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578345856 00000100:00100000:1.0:1788830566.792097:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 246 00000100:00100000:1.0:1788830566.792108:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25474a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+13:2355:x1875724578345856:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:1.0:1788830566.792177:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25474a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+13:2355:x1875724578345856:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 71us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830566.792185:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 246 00000100:00100000:1.0:1788830566.792223:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578345984 00000100:00100000:1.0:1788830566.792228:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578345984 00000100:00100000:1.0:1788830566.792267:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 89 00000100:00100000:1.0:1788830566.792274:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25478b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+14:2355:x1875724578345984:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:1.0:1788830566.792310:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25478b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+14:2355:x1875724578345984:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 36us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830566.792316:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 89 00000100:00080000:1.0:1788830566.792333:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788830566.792416:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830566.792525:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578346112 00000100:00100000:3.0:1788830566.792529:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578346112 00000100:00100000:3.0:1788830566.792563:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 54 00000100:00100000:3.0:1788830566.792570:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25478b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+5:2355:x1875724578346112:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:3.0:1788830566.792616:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25478b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+5:2355:x1875724578346112:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 46us (692us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830566.792632:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 54 00000100:00100000:3.0:1788830566.792651:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578346240 00000100:00100000:3.0:1788830566.792654:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578346240 00000100:00100000:3.0:1788830566.792678:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 90 00000100:00100000:3.0:1788830566.792683:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2545cbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2154ea6-69cb-4a30-aac0-000fba13e98b+5:2355:x1875724578346240:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:3.0:1788830566.792772:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2545cbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2154ea6-69cb-4a30-aac0-000fba13e98b+5:2355:x1875724578346240:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 87us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830566.792779:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 90 00000100:00080000:1.0:1788830566.792900:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788830566.792904:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:0.0:1788830566.976625:0:11609:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000100:00100000:0.0:1788830567.132058:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2545cbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1745cc3d-3952-4cd4-9020-9b8acb483105:3307:1875724595153792:0@lo:400:kworker.0 00000100:00100000:0.0:1788830567.132132:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830567.132244:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595153792 00000100:00100000:1.0:1788830567.132253:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595153792 00000100:00100000:1.0:1788830567.132301:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1788830567.132311:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25474aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1745cc3d-3952-4cd4-9020-9b8acb483105+19:3307:x1875724595153792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788830567.137684:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25474aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1745cc3d-3952-4cd4-9020-9b8acb483105+19:3307:x1875724595153792:12345-0@lo:400:kworker.0 Request processed in 5368us (5544us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830567.137722:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1788830567.138727:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2545cbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875724595153920:0@lo:400:kworker.0 00000100:00100000:3.0:1788830567.138788:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830567.138819:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2565433b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875724595154432:0@lo:400:kworker.0 00000100:00100000:3.0:1788830567.138845:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830567.138873:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788830567.138879:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2565430000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1875724595154304:0@lo:400:kworker.0 00000100:00100000:3.0:1788830567.138899:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830567.139920:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25479a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875724595154048:0@lo:400:kworker.0 00000100:00100000:3.0:1788830567.139956:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830567.140092:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595153920 00000100:00100000:1.0:1788830567.140100:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595153920 00000100:00100000:1.0:1788830567.140142:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595154304 00000100:00100000:1.0:1788830567.140145:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595154304 00000100:00100000:1.0:1788830567.140175:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788830567.140183:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2565431c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875724595153920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788830567.140235:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2565431c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875724595153920:12345-0@lo:400:kworker.0 Request processed in 53us (1447us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830567.140242:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788830567.140260:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788830567.140267:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2565432680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875724595154304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788830567.140294:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2565432680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875724595154304:12345-0@lo:400:kworker.0 Request processed in 28us (1393us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830567.140300:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00080000:1.0:1788830567.140320:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788830567.140429:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788830567.140437:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257f727100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875724595154176:0@lo:400:kworker.0 00000100:00100000:3.0:1788830567.140463:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830567.140572:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595154432 00000100:00100000:3.0:1788830567.140577:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595154432 00000100:00100000:3.0:1788830567.140778:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595154048 00000100:00100000:3.0:1788830567.140783:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595154048 00000100:00100000:3.0:1788830567.140805:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788830567.140812:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2565431500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875724595154432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788830567.140859:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2565431500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875724595154432:12345-0@lo:400:kworker.0 Request processed in 48us (2013us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830567.140865:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788830567.140878:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788830567.140885:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2565430e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875724595154048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788830567.140916:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2565430e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875724595154048:12345-0@lo:400:kworker.0 Request processed in 31us (959us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830567.140922:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788830567.140937:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595154176 00000100:00100000:3.0:1788830567.140941:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595154176 00000100:00100000:3.0:1788830567.140965:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788830567.140971:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2565431f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875724595154176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788830567.142423:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2565431f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875724595154176:12345-0@lo:400:kworker.0 Request processed in 1449us (1956us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830567.142433:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788830567.143066:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2565430000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1875724595154304:0@lo:400:kworker.0 00000100:00100000:3.0:1788830567.143085:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2545cbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875724595153920:0@lo:400:kworker.0 00010000:00080000:3.0:1788830567.143099:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e2565433b80 x1875724595154432/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788830583 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788830567.143109:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2565433b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875724595154432:0@lo:400:kworker.0 00000100:00100000:3.0:1788830567.143153:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257f727100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875724595154176:0@lo:400:kworker.0 00010000:00080000:3.0:1788830567.143166:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e25479a1500 x1875724595154048/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788830583 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788830567.143174:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25479a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875724595154048:0@lo:400:kworker.0 00000100:00080000:3.0:1788830567.143207:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788830567.143213:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788830567.150111:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2545cbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1745cc3d-3952-4cd4-9020-9b8acb483105:3307:1875724595153792:0@lo:400:kworker.0 00010000:00010000:1.0:1788830567.461120:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788830567.643893:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2565433b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875724595154560:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788830567.643964:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830567.644059:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595154560 00000100:00100000:3.0:1788830567.644066:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595154560 00000100:00100000:3.0:1788830567.644107:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788830567.644114:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255130a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875724595154560:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788830567.644143:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788830567.644178:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255130a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875724595154560:12345-0@lo:13:osp-pre-1-0.0 Request processed in 64us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830567.644182:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:3.0:1788830567.644212:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e2565433b80 x1875724595154560/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788830583 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788830567.644226:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2565433b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875724595154560:0@lo:13:osp-pre-1-0.0 00000020:00000080:3.0:1788830568.080895:0:11657:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd96a1e0e0 20000000:00000080:3.0:1788830568.080913:0:11657:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9e25656ce000 uarg=0000000000000000 20000000:01000000:3.0:1788830568.080951:0:11657:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1788830568.080958:0:11657:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1788830568.080963:0:11657:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:1.0:1788830568.081891:0:11658:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:3.0:1788830568.082125:0:11657:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:3.0:1788830568.091350:0:11657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:3.0:1788830568.091413:0:11657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:3.0:1788830568.091963:0:11657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:3.0:1788830568.091988:0:11657:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788830568.092010:0:11657:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e257d80e200/0x575506951eea0d2d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830568.092030:0:11657:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2565729a00/0x575506951eea0bcf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661c5e expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830568.092053:0:11657:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2565728e00/0x575506951eea0bd6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661c65 expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830568.092061:0:11657:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2565728c00/0x575506951eea0be4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x575506951eea0bdd expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830568.092068:0:11657:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2565729400/0x575506951eea0bf2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x575506951eea0beb expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830568.092073:0:11657:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e257d944000/0x575506951eea0c00 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x575506951eea0bf9 expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830568.092081:0:11657:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e257d80e200/0x575506951eea0d2d lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830568.092123:0:11657:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e257d944000/0x575506951eea0c00 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x575506951eea0bf9 expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830568.092138:0:11657:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e257d944000/0x575506951eea0c00 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x575506951eea0bf9 expref: 18 pid: 5824 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788830568.092153:0:11657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2565433b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11657:1875724595154688:0@lo:104: 00000100:00100000:3.0:1788830568.092220:0:11657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788830568.092356:0:11657:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2565729400/0x575506951eea0bf2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x575506951eea0beb expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830568.092364:0:11657:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e2565729400/0x575506951eea0bf2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x575506951eea0beb expref: 18 pid: 5827 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788830568.092383:0:11657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2565433480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11657:1875724595154816:0@lo:104: 00000100:00100000:3.0:1788830568.092416:0:11657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788830568.093790:0:11657:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2565728c00/0x575506951eea0be4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x575506951eea0bdd expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830568.093807:0:11657:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e2565728c00/0x575506951eea0be4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x575506951eea0bdd expref: 18 pid: 5826 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788830568.093820:0:11657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2565430a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11657:1875724595154944:0@lo:104: 00010000:00010000:3.0:1788830568.093865:0:11657:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2565728e00/0x575506951eea0bd6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.21@tcp remote: 0xa578910534661c65 expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830568.093876:0:11657:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e2565728e00/0x575506951eea0bd6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661c65 expref: 12 pid: 5827 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788830568.093884:0:11657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2565432a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11657:1875724595155072:192.168.201.21@tcp:104: 00010000:00010000:3.0:1788830568.093940:0:11657:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2565729a00/0x575506951eea0bcf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.21@tcp remote: 0xa578910534661c5e expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830568.093950:0:11657:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e2565729a00/0x575506951eea0bcf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661c5e expref: 12 pid: 5826 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788830568.093958:0:11657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2565432d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11657:1875724595155200:192.168.201.21@tcp:104: 00000100:00100000:3.0:1788830568.093980:0:11657:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2444a6c300 going to sleep for 11 seconds 00000100:00100000:0.0:1788830568.096172:0:11657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2565432a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11657:1875724595155072:192.168.201.21@tcp:104: 00000100:00100000:0.0:1788830568.096187:0:11657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2565432d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11657:1875724595155200:192.168.201.21@tcp:104: 00000100:00100000:0.0:1788830568.096509:0:8504:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788830568.096539:0:8504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830568.096569:0:8504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595154688 00000100:00100000:0.0:1788830568.096602:0:8504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595154688 00000100:00100000:0.0:1788830568.096645:0:8504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595154816 00000100:00100000:0.0:1788830568.096647:0:8504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595154816 00000100:00100000:0.0:1788830568.096656:0:8504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595154944 00000100:00100000:0.0:1788830568.096657:0:8504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595154944 00000100:00100000:0.0:1788830568.096668:0:8504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788830568.096675:0:8504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2565430000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:1745cc3d-3952-4cd4-9020-9b8acb483105+5:11657:x1875724595154688:12345-0@lo:104: 00010000:00010000:0.0:1788830568.096690:0:8504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.121@tcp lock: ffff9e25820ff200/0x575506951eea0bf9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x575506951eea0c00 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830568.096768:0:8504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788830568.096774:0:8504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2565430000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:1745cc3d-3952-4cd4-9020-9b8acb483105+5:11657:x1875724595154688:12345-0@lo:104: Request processed in 99us (4554us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830568.096781:0:8504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788830568.096796:0:8504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788830568.096802:0:8504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257fb2b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:1745cc3d-3952-4cd4-9020-9b8acb483105+4:11657:x1875724595154816:12345-0@lo:104: 00010000:00010000:0.0:1788830568.096809:0:8504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.121@tcp lock: ffff9e25820ffa00/0x575506951eea0beb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x575506951eea0bf2 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830568.096843:0:8504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788830568.096848:0:8504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257fb2b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:1745cc3d-3952-4cd4-9020-9b8acb483105+4:11657:x1875724595154816:12345-0@lo:104: Request processed in 47us (4432us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830568.096854:0:8504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788830568.096883:0:8504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788830568.096889:0:8504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2551308e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:1745cc3d-3952-4cd4-9020-9b8acb483105+3:11657:x1875724595154944:12345-0@lo:104: 00010000:00010000:0.0:1788830568.096896:0:8504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.121@tcp lock: ffff9e25820ffe00/0x575506951eea0bdd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x575506951eea0be4 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830568.096922:0:8504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788830568.096933:0:8504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2551308e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:1745cc3d-3952-4cd4-9020-9b8acb483105+3:11657:x1875724595154944:12345-0@lo:104: Request processed in 45us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830568.096939:0:8504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00010000:0.0:1788830568.096957:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788830568.096963:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.121@tcp lock: ffff9e25820ff200/0x575506951eea0bf9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x575506951eea0c00 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830568.096970:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e25820ff200 already unused, calling callback (ffffffffc1aebc20) 10000000:00010000:0.0:1788830568.096974:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.121@tcp lock: ffff9e25820ff200/0x575506951eea0bf9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x575506951eea0c00 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830568.096982:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.121@tcp lock: ffff9e25820ff200/0x575506951eea0bf9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x575506951eea0c00 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788830568.096989:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.121@tcp lock: ffff9e25820ff200/0x575506951eea0bf9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x575506951eea0c00 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788830568.096995:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788830568.097033:0:5820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.121@tcp lock: ffff9e25820ff200/0x575506951eea0bf9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x575506951eea0c00 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830568.097040:0:5820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788830568.097074:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.121@tcp lock: ffff9e25820ff200/0x575506951eea0bf9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x575506951eea0c00 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830568.097081:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.121@tcp lock: ffff9e25820ff200/0x575506951eea0bf9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x575506951eea0c00 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830568.097095:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788830568.097098:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.121@tcp lock: ffff9e25820ffa00/0x575506951eea0beb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x575506951eea0bf2 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830568.097115:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e25820ffa00 already unused, calling callback (ffffffffc1aebc20) 10000000:00010000:0.0:1788830568.097119:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.121@tcp lock: ffff9e25820ffa00/0x575506951eea0beb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x575506951eea0bf2 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830568.097124:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.121@tcp lock: ffff9e25820ffa00/0x575506951eea0beb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x575506951eea0bf2 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788830568.097130:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.121@tcp lock: ffff9e25820ffa00/0x575506951eea0beb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x575506951eea0bf2 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788830568.097134:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788830568.097148:0:5820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.121@tcp lock: ffff9e25820ffa00/0x575506951eea0beb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x575506951eea0bf2 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830568.097153:0:5820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788830568.097167:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.121@tcp lock: ffff9e25820ffa00/0x575506951eea0beb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x575506951eea0bf2 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830568.097172:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.121@tcp lock: ffff9e25820ffa00/0x575506951eea0beb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x575506951eea0bf2 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830568.097180:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788830568.097183:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.121@tcp lock: ffff9e25820ffe00/0x575506951eea0bdd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x575506951eea0be4 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830568.097188:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e25820ffe00 already unused, calling callback (ffffffffc1aebc20) 10000000:00010000:0.0:1788830568.097190:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.121@tcp lock: ffff9e25820ffe00/0x575506951eea0bdd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x575506951eea0be4 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830568.097207:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.121@tcp lock: ffff9e25820ffe00/0x575506951eea0bdd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x575506951eea0be4 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788830568.097212:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.121@tcp lock: ffff9e25820ffe00/0x575506951eea0bdd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x575506951eea0be4 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788830568.097216:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788830568.097229:0:5820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.121@tcp lock: ffff9e25820ffe00/0x575506951eea0bdd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x575506951eea0be4 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830568.097235:0:5820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788830568.097241:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.121@tcp lock: ffff9e25820ffe00/0x575506951eea0bdd lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x575506951eea0be4 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830568.097248:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.121@tcp lock: ffff9e25820ffe00/0x575506951eea0bdd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x575506951eea0be4 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830568.097261:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788830568.097262:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788830568.097264:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788830568.097284:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2551309f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1745cc3d-3952-4cd4-9020-9b8acb483105:3310:1875724595155328:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788830568.097316:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830568.097359:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e255130b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1745cc3d-3952-4cd4-9020-9b8acb483105:3307:1875724595155456:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788830568.097381:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830568.097395:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788830568.097400:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2551308a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1745cc3d-3952-4cd4-9020-9b8acb483105:3307:1875724595155584:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788830568.097418:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830568.097443:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595155328 00000100:00100000:0.0:1788830568.097453:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595155328 00010000:00010000:0.0:1788830568.097472:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e257d944000/0x575506951eea0c00 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x575506951eea0bf9 expref: 19 pid: 5824 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788830568.097491:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595155456 00000100:00100000:0.0:1788830568.097494:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595155456 00010000:00010000:0.0:1788830568.097504:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2565729400/0x575506951eea0bf2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x575506951eea0beb expref: 20 pid: 5827 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788830568.097513:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595155584 00000100:00100000:0.0:1788830568.097515:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595155584 00010000:00010000:0.0:1788830568.097523:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2565728c00/0x575506951eea0be4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x575506951eea0bdd expref: 21 pid: 5826 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788830568.097533:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788830568.097538:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255130aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1745cc3d-3952-4cd4-9020-9b8acb483105+21:3310:x1875724595155328:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788830568.097547:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788830568.097552:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e257d944000/0x575506951eea0c00 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x575506951eea0bf9 expref: 21 pid: 5824 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830568.097562:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e257d944000/0x575506951eea0c00 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x575506951eea0bf9 expref: 21 pid: 5824 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830568.097591:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788830568.097621:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255130aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1745cc3d-3952-4cd4-9020-9b8acb483105+21:3310:x1875724595155328:12345-0@lo:103:ldlm_bl.0 Request processed in 82us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830568.097627:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788830568.097642:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788830568.097648:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255130ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1745cc3d-3952-4cd4-9020-9b8acb483105+20:3307:x1875724595155456:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788830568.097655:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788830568.097664:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2565729400/0x575506951eea0bf2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x575506951eea0beb expref: 20 pid: 5827 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830568.097673:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2565729400/0x575506951eea0bf2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x575506951eea0beb expref: 20 pid: 5827 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830568.097683:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788830568.097733:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255130ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1745cc3d-3952-4cd4-9020-9b8acb483105+20:3307:x1875724595155456:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830568.097740:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788830568.097753:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788830568.097759:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2547436450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1745cc3d-3952-4cd4-9020-9b8acb483105+19:3307:x1875724595155584:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788830568.097766:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788830568.097771:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2565728c00/0x575506951eea0be4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x575506951eea0bdd expref: 19 pid: 5826 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830568.097779:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2565728c00/0x575506951eea0be4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x575506951eea0bdd expref: 19 pid: 5826 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830568.097788:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788830568.097808:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2547436450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1745cc3d-3952-4cd4-9020-9b8acb483105+19:3307:x1875724595155584:12345-0@lo:103:ldlm_bl.0 Request processed in 50us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830568.097814:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788830568.097861:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2551309f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1745cc3d-3952-4cd4-9020-9b8acb483105:3310:1875724595155328:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788830568.097885:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2551308a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1745cc3d-3952-4cd4-9020-9b8acb483105:3307:1875724595155584:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788830568.097891:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e255130b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1745cc3d-3952-4cd4-9020-9b8acb483105:3307:1875724595155456:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788830568.097921:0:11657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e257d944000/0x575506951eea0c00 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x575506951eea0bf9 expref: 18 pid: 5824 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788830568.097945:0:11657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2565433b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11657:1875724595154688:0@lo:104: 00010000:00010000:0.0:1788830568.097958:0:11657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2565729400/0x575506951eea0bf2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x575506951eea0beb expref: 17 pid: 5827 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788830568.097969:0:11657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2565433480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11657:1875724595154816:0@lo:104: 00010000:00010000:0.0:1788830568.097979:0:11657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2565728c00/0x575506951eea0be4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x575506951eea0bdd expref: 16 pid: 5826 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788830568.097986:0:11657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2565430a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11657:1875724595154944:0@lo:104: 00010000:00010000:0.0:1788830568.098015:0:11657:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e257d80e200/0x575506951eea0d2d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830568.098874:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788830568.099016:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830568.099042:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830568.099344:0:5816:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 0 new 8192-byte reqbufs (1/1 left), rc = 0 00000100:00100000:3.0:1788830568.099473:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578346368 00000100:00100000:3.0:1788830568.099484:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578346368 00010000:00010000:3.0:1788830568.099532:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2565728e00/0x575506951eea0bd6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661c65 expref: 13 pid: 5827 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788830568.099553:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578346496 00000100:00100000:3.0:1788830568.099557:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578346496 00010000:00010000:3.0:1788830568.099568:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2565729a00/0x575506951eea0bcf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661c5e expref: 14 pid: 5826 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788830568.099600:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 33 00000100:00100000:3.0:1788830568.099609:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255130b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+14:2355:x1875724578346368:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788830568.099621:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788830568.099626:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2565728e00/0x575506951eea0bd6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661c65 expref: 14 pid: 5827 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830568.099637:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2565728e00/0x575506951eea0bd6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661c65 expref: 14 pid: 5827 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830568.099652:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2565728e00/0x575506951eea0bd6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661c65 expref: 14 pid: 5827 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830568.099663:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788830568.099802:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255130b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+13:2355:x1875724578346368:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 193us (788us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830568.099809:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 33 00000100:00100000:3.0:1788830568.099828:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 34 00000100:00100000:3.0:1788830568.099835:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2551308a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+12:2355:x1875724578346496:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788830568.099844:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788830568.099848:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2565729a00/0x575506951eea0bcf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661c5e expref: 12 pid: 5826 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830568.099864:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2565729a00/0x575506951eea0bcf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661c5e expref: 12 pid: 5826 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830568.099874:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2565729a00/0x575506951eea0bcf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661c5e expref: 12 pid: 5826 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830568.099885:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e257d80e200/0x575506951eea0d2d lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830568.099893:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e257d80e200/0x575506951eea0d2d lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830568.099908:0:5818:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e257d80e200/0x575506951eea0d2d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830568.099915:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e257d80e200/0x575506951eea0d2d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830568.099922:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e257d80e200/0x575506951eea0d2d lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830568.099929:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e257d80e200/0x575506951eea0d2d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830568.099935:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e257d80e200 already unused, calling callback (ffffffffc14cb350) 00010000:00010000:3.0:1788830568.099939:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e257d80e200/0x575506951eea0d2d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830568.099947:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e257d80e200/0x575506951eea0d2d lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830568.099972:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e257d80e200/0x575506951eea0d2d lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830568.099980:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788830568.100000:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2551308a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+11:2355:x1875724578346496:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 165us (957us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830568.100007:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 34 00010000:00010000:0.0:1788830568.100258:0:11657:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e257d80e200/0x575506951eea0d2d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830568.100269:0:11657:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e257d80e200/0x575506951eea0d2d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830568.100275:0:11657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e257d80e200/0x575506951eea0d2d lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788830568.226885:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967302 is committed 00000001:00080000:0.0:1788830568.226899:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:0.0:1788830568.226917:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000004:00080000:0.0:1788830568.226936:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:0.0:1788830568.227063:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788830568.227106:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2551309f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875724595155712:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788830568.227186:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830568.229097:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595155712 00000100:00100000:3.0:1788830568.229113:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595155712 00000100:00100000:3.0:1788830568.229217:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788830568.229227:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255130aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875724595155712:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788830568.229259:0:6679:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:3.0:1788830568.229300:0:6679:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a9f6362, atime: 0x6a9f6362, ctime: 0x6a9f6362, blocks: 0x1 00010000:00010000:3.0:1788830568.229308:0:6679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f611a07/0x575506951eea0d34 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830568.229326:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=321s v=(0 0) 00010000:00010000:3.0:1788830568.229331:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788830568.229338:0:6679:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f611a07/0x575506951eea0d34 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830568.229355:0:6679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f611a07/0x575506951eea0d34 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830568.229365:0:6679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f611a07/0x575506951eea0d34 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830568.229385:0:6679:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005f611a07/0x575506951eea0d34 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830568.229403:0:6679:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788830568.229851:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788830568.229857:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005f611a07/0x575506951eea0d34 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830568.229866:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e257d80e600 already unused, calling callback (ffffffffc14cb350) 00010000:00010000:3.0:1788830568.229870:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005f611a07/0x575506951eea0d34 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830568.229879:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005f611a07/0x575506951eea0d34 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830568.229895:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005f611a07/0x575506951eea0d34 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830568.229902:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f611a07/0x575506951eea0d34 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830568.229919:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788830568.229921:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788830568.229922:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788830568.230372:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255130aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3310:x1875724595155712:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1145us (3184us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1788830568.230390:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000004:00080000:3.0:1788830568.230641:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e2551309f80/2, rc 0, transno 4294967300 00000100:00100000:3.0:1788830568.230651:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2551309f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875724595155712:0@lo:6:osp-syn-0-0.0 00000100:00080000:0.0:1788830568.233547:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788830568.476115:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788830569.499878:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788830569.542664:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830569.543102:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578346624 00000100:00100000:0.0:1788830569.543115:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578346624 00000100:00100000:0.0:1788830569.543237:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 248 00000100:00100000:0.0:1788830569.543249:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25747bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+11:5593:x1875724578346624:12345-192.168.201.21@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788830569.543267:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788830569.543288:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2445b7fe00/0x575506951eea0d3b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa578910534661cb2 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830569.543317:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2445b7fe00/0x575506951eea0d3b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661cb2 expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830569.543328:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2445b7fe00/0x575506951eea0d3b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661cb2 expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830569.543338:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2445b7fe00, rc 0) 00000100:00100000:0.0:1788830569.543406:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25747bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+12:5593:x1875724578346624:12345-192.168.201.21@tcp:101:ll_cfg_requeue.0 Request processed in 159us (752us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830569.543413:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 248 00000100:00100000:3.0:1788830569.548356:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830569.551397:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578346752 00000100:00100000:2.0:1788830569.551412:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578346752 00000100:00100000:2.0:1788830569.551527:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 249 00000100:00100000:2.0:1788830569.551539:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25747bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+12:5593:x1875724578346752:12345-192.168.201.21@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788830569.552013:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25747bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+12:5593:x1875724578346752:12345-192.168.201.21@tcp:501:ll_cfg_requeue.0 Request processed in 475us (3665us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830569.552022:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 249 00000100:00100000:1.0:1788830569.554347:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830569.554455:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578346880 00000100:00100000:2.0:1788830569.554466:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578346880 00000100:00100000:2.0:1788830569.554511:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 250 00000100:00100000:2.0:1788830569.554522:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25747bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+12:5593:x1875724578346880:12345-192.168.201.21@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788830569.554983:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25747bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+12:5593:x1875724578346880:12345-192.168.201.21@tcp:503:ll_cfg_requeue.0 Request processed in 462us (643us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830569.554992:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 250 10000000:01000000:0.0:1788830569.563833:0:5829:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788830569.563842:0:5829:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e2444ab0800 from 7 10000000:01000000:0.0:1788830569.563847:0:5829:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788830569.563911:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.121@tcp lock: ffff9e2445b7fa00/0x575506951eea0d42 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830569.564099:0:5829:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.121@tcp lock: ffff9e2445b7fa00/0x575506951eea0d42 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830569.564134:0:5829:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.121@tcp lock: ffff9e2445b7fa00/0x575506951eea0d42 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788830569.564161:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e255130ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1745cc3d-3952-4cd4-9020-9b8acb483105:5829:1875724595155840:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788830569.564231:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830569.564354:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e24452d8840 going to sleep for 11 seconds 00000100:00100000:3.0:1788830569.569053:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830569.574873:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595155840 00000100:00100000:0.0:1788830569.574873:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578347008 00000100:00100000:0.0:1788830569.574890:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578347008 00000100:00100000:1.0:1788830569.574904:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595155840 00000100:00100000:0.0:1788830569.575039:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 251 00000100:00100000:0.0:1788830569.575051:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25747bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+12:9949:x1875724578347008:12345-192.168.201.21@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788830569.575359:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25747bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+12:9949:x1875724578347008:12345-192.168.201.21@tcp:502:llog_process_th.0 Request processed in 309us (6314us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830569.575368:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 251 00000100:00100000:2.0:1788830569.577373:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1788830569.577394:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25747bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+16:5829:x1875724595155840:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788830569.577410:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788830569.577439:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2565728000/0x575506951eea0d49 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x575506951eea0d42 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830569.577467:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2565728000/0x575506951eea0d49 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x575506951eea0d42 expref: 17 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830569.577478:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2565728000/0x575506951eea0d49 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x575506951eea0d42 expref: 17 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830569.577498:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2565728000, rc 0) 00000100:00100000:2.0:1788830569.583311:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25747bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+17:5829:x1875724595155840:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 5914us (19067us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830569.583326:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1788830569.584234:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830569.584392:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e255130ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1745cc3d-3952-4cd4-9020-9b8acb483105:5829:1875724595155840:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788830569.584421:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.121@tcp lock: ffff9e2445b7fa00/0x575506951eea0d42 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea0d49 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830569.584444:0:5829:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.121@tcp lock: ffff9e2445b7fa00/0x575506951eea0d42 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x575506951eea0d49 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788830569.584537:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e255130ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1745cc3d-3952-4cd4-9020-9b8acb483105:5829:1875724595155968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788830569.584585:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830569.584637:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e24452d8840 going to sleep for 11 seconds 00000100:00100000:3.0:1788830569.584866:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578347136 00000100:00100000:3.0:1788830569.584873:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578347136 00000100:00100000:3.0:1788830569.584903:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595155968 00000100:00100000:3.0:1788830569.584906:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595155968 00000100:00100000:3.0:1788830569.584921:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 253 00000100:00100000:3.0:1788830569.584930:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25747bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+12:9949:x1875724578347136:12345-192.168.201.21@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788830569.585184:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25747bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+12:9949:x1875724578347136:12345-192.168.201.21@tcp:502:llog_process_th.0 Request processed in 253us (955us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830569.585191:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 253 00000100:00100000:3.0:1788830569.585215:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1788830569.585222:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25747bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+17:5829:x1875724595155968:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788830569.585461:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25747bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+17:5829:x1875724595155968:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 238us (875us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830569.585467:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1788830569.585826:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e255130ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1745cc3d-3952-4cd4-9020-9b8acb483105:5829:1875724595155968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788830569.585865:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e255130ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1745cc3d-3952-4cd4-9020-9b8acb483105:5829:1875724595156096:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788830569.585914:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830569.585942:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e24452d8840 going to sleep for 11 seconds 00000100:00100000:0.0:1788830569.585969:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595156096 00000100:00100000:0.0:1788830569.585973:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595156096 00000100:00100000:0.0:1788830569.585995:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1788830569.586002:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25747bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+17:5829:x1875724595156096:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788830569.586120:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25747bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+17:5829:x1875724595156096:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 118us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830569.586128:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1788830569.586137:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e255130ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1745cc3d-3952-4cd4-9020-9b8acb483105:5829:1875724595156096:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788830569.592137:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830569.592351:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578347264 00000100:00100000:0.0:1788830569.592364:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578347264 00000100:00100000:0.0:1788830569.592437:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 256 00000100:00100000:0.0:1788830569.592447:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e254812d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+12:5593:x1875724578347264:12345-192.168.201.21@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788830569.592465:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788830569.592483:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2445b7f600/0x575506951eea0d50 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa578910534661cb9 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830569.592509:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2445b7f600/0x575506951eea0d50 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661cb9 expref: 13 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830569.592642:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2445b7f600/0x575506951eea0d50 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661cb9 expref: 13 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830569.592651:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2445b7f600, rc 0) 00000100:00100000:0.0:1788830569.592706:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e254812d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+13:5593:x1875724578347264:12345-192.168.201.21@tcp:101:ll_cfg_requeue.0 Request processed in 260us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830569.592749:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 256 00000100:00100000:2.0:1788830569.593935:0:11672:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e255005ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1745cc3d-3952-4cd4-9020-9b8acb483105:11672:1875724595156224:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788830569.594009:0:11672:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788830569.594052:0:11672:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2553723f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788830569.594255:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595156224 00000100:00100000:0.0:1788830569.594262:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595156224 00000100:00100000:0.0:1788830569.594373:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1788830569.594383:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e254812d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1745cc3d-3952-4cd4-9020-9b8acb483105+17:11672:x1875724595156224:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788830569.594658:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e254812d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1745cc3d-3952-4cd4-9020-9b8acb483105+17:11672:x1875724595156224:12345-0@lo:502:llog_process_th.0 Request processed in 275us (648us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830569.594667:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1788830569.594758:0:11672:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e255005ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1745cc3d-3952-4cd4-9020-9b8acb483105:11672:1875724595156224:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788830569.594791:0:11672:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788830569.594801:0:11672:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788830569.594803:0:11672:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788830569.594810:0:11672:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9e2444ab0800 00000020:00000080:2.0:1788830569.594813:0:11672:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788830569.594900:0:11672:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e255005ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1745cc3d-3952-4cd4-9020-9b8acb483105:11672:1875724595156352:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788830569.594936:0:11672:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788830569.601135:0:11672:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2553723f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788830569.601828:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830569.601911:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595156352 00000100:00100000:1.0:1788830569.601920:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595156352 00000100:00100000:1.0:1788830569.601969:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1788830569.601980:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e254812f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1745cc3d-3952-4cd4-9020-9b8acb483105+17:11672:x1875724595156352:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788830569.602230:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e254812f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1745cc3d-3952-4cd4-9020-9b8acb483105+17:11672:x1875724595156352:12345-0@lo:502:llog_process_th.0 Request processed in 251us (7293us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830569.602237:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1788830569.602412:0:11672:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e255005ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1745cc3d-3952-4cd4-9020-9b8acb483105:11672:1875724595156352:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788830569.602457:0:11672:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788830569.602465:0:11672:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788830569.602467:0:11672:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1788830569.602471:0:11672:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1788830569.602883:0:5829:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1788830569.602901:0:5829:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788830569.602912:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: ffff9e2445b7fa00/0x575506951eea0d42 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea0d49 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830569.602924:0:5829:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.121@tcp lock: ffff9e2445b7fa00/0x575506951eea0d42 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea0d49 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788830569.602934:0:5829:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788830569.602937:0:5829:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e2565dcd800 from 7 10000000:01000000:1.0:1788830569.602939:0:5829:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788830569.602972:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.121@tcp lock: ffff9e2540031200/0x575506951eea0d57 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830569.602978:0:5829:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.121@tcp lock: ffff9e2540031200/0x575506951eea0d57 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830569.602999:0:5829:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.121@tcp lock: ffff9e2540031200/0x575506951eea0d57 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788830569.603019:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257fa66d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1745cc3d-3952-4cd4-9020-9b8acb483105:5829:1875724595156480:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788830569.603056:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830569.603087:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e254747f300 going to sleep for 11 seconds 00000100:00100000:1.0:1788830569.603103:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595156480 00000100:00100000:1.0:1788830569.603108:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595156480 00000100:00100000:1.0:1788830569.603133:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1788830569.603140:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255d99a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1745cc3d-3952-4cd4-9020-9b8acb483105+17:5829:x1875724595156480:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788830569.603151:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788830569.603164:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2540031c00/0x575506951eea0d5e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x575506951eea0d57 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830569.603188:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2540031c00/0x575506951eea0d5e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x575506951eea0d57 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830569.603200:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2540031c00/0x575506951eea0d5e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x575506951eea0d57 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830569.603209:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2540031c00, rc 0) 00000100:00100000:1.0:1788830569.603240:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255d99a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1745cc3d-3952-4cd4-9020-9b8acb483105+18:5829:x1875724595156480:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 99us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830569.603246:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1788830569.603277:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257fa66d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1745cc3d-3952-4cd4-9020-9b8acb483105:5829:1875724595156480:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788830569.603288:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.121@tcp lock: ffff9e2540031200/0x575506951eea0d57 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea0d5e expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830569.603357:0:5829:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.121@tcp lock: ffff9e2540031200/0x575506951eea0d57 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x575506951eea0d5e expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788830569.603411:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257fa66d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1745cc3d-3952-4cd4-9020-9b8acb483105:5829:1875724595156608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788830569.603506:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830569.603599:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e254747f300 going to sleep for 11 seconds 00000100:00100000:1.0:1788830569.603612:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595156608 00000100:00100000:1.0:1788830569.603616:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595156608 00000100:00100000:1.0:1788830569.603728:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1788830569.603735:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255d999450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1745cc3d-3952-4cd4-9020-9b8acb483105+18:5829:x1875724595156608:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788830569.603966:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255d999450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1745cc3d-3952-4cd4-9020-9b8acb483105+18:5829:x1875724595156608:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 230us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830569.603973:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1788830569.604004:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257fa66d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1745cc3d-3952-4cd4-9020-9b8acb483105:5829:1875724595156608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788830569.604033:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257fa66d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1745cc3d-3952-4cd4-9020-9b8acb483105:5829:1875724595156736:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788830569.604072:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830569.604086:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e254747f300 going to sleep for 11 seconds 00000100:00100000:1.0:1788830569.604097:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595156736 00000100:00100000:1.0:1788830569.604100:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595156736 00000100:00100000:1.0:1788830569.604117:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1788830569.604123:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255d99bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1745cc3d-3952-4cd4-9020-9b8acb483105+18:5829:x1875724595156736:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788830569.604263:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255d99bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1745cc3d-3952-4cd4-9020-9b8acb483105+18:5829:x1875724595156736:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 139us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830569.604270:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1788830569.604328:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257fa66d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1745cc3d-3952-4cd4-9020-9b8acb483105:5829:1875724595156736:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788830569.604944:0:11674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257fa66d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1745cc3d-3952-4cd4-9020-9b8acb483105:11674:1875724595156864:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788830569.604988:0:11674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830569.605011:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595156864 00000100:00100000:1.0:1788830569.605016:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595156864 00000100:00100000:1.0:1788830569.605043:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1788830569.605050:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255d999050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1745cc3d-3952-4cd4-9020-9b8acb483105+18:11674:x1875724595156864:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788830569.605190:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255d999050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1745cc3d-3952-4cd4-9020-9b8acb483105+18:11674:x1875724595156864:12345-0@lo:502:llog_process_th.0 Request processed in 140us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830569.605196:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1788830569.605224:0:11674:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e254747ff00 going to sleep for 11 seconds 00000100:00100000:1.0:1788830569.605236:0:11674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257fa66d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1745cc3d-3952-4cd4-9020-9b8acb483105:11674:1875724595156864:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788830569.605274:0:11674:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788830569.605284:0:11674:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788830569.605286:0:11674:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788830569.605331:0:11674:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9e2565dcd800 00000020:00000080:1.0:1788830569.605334:0:11674:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788830569.605414:0:11674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257fa66d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1745cc3d-3952-4cd4-9020-9b8acb483105:11674:1875724595156992:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788830569.605607:0:11674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830569.605705:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595156992 00000100:00100000:1.0:1788830569.605731:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595156992 00000100:00100000:1.0:1788830569.605766:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1788830569.605773:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255d99b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1745cc3d-3952-4cd4-9020-9b8acb483105+18:11674:x1875724595156992:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788830569.605895:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255d99b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1745cc3d-3952-4cd4-9020-9b8acb483105+18:11674:x1875724595156992:12345-0@lo:502:llog_process_th.0 Request processed in 122us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830569.605902:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1788830569.605937:0:11674:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e24469d4000 going to sleep for 11 seconds 00000100:00100000:1.0:1788830569.605950:0:11674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257fa66d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1745cc3d-3952-4cd4-9020-9b8acb483105:11674:1875724595156992:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788830569.605968:0:11674:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788830569.605973:0:11674:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788830569.605974:0:11674:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1788830569.605978:0:11674:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1788830569.606029:0:5829:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1788830569.606050:0:5829:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788830569.606059:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: ffff9e2540031200/0x575506951eea0d57 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea0d5e expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830569.606070:0:5829:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.121@tcp lock: ffff9e2540031200/0x575506951eea0d57 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea0d5e expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788830569.606081:0:5829:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788830569.606084:0:5829:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e255d9b0800 from 7 10000000:01000000:1.0:1788830569.606087:0:5829:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788830569.606110:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.121@tcp lock: ffff9e2540030600/0x575506951eea0d65 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830569.606118:0:5829:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.121@tcp lock: ffff9e2540030600/0x575506951eea0d65 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830569.606126:0:5829:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.121@tcp lock: ffff9e2540030600/0x575506951eea0d65 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788830569.606139:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257fa66d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1745cc3d-3952-4cd4-9020-9b8acb483105:5829:1875724595157120:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788830569.606165:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830569.606177:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e24469d4000 going to sleep for 11 seconds 00000100:00100000:1.0:1788830569.606190:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595157120 00000100:00100000:1.0:1788830569.606199:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595157120 00000100:00100000:1.0:1788830569.606216:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1788830569.606221:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255d998850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1745cc3d-3952-4cd4-9020-9b8acb483105+18:5829:x1875724595157120:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788830569.606229:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788830569.606239:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2540031e00/0x575506951eea0d6c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x575506951eea0d65 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830569.606257:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2540031e00/0x575506951eea0d6c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x575506951eea0d65 expref: 19 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830569.606267:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2540031e00/0x575506951eea0d6c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x575506951eea0d65 expref: 19 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830569.606274:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2540031e00, rc 0) 00000100:00100000:1.0:1788830569.606301:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255d998850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1745cc3d-3952-4cd4-9020-9b8acb483105+19:5829:x1875724595157120:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 79us (135us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830569.606307:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1788830569.606333:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257fa66d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1745cc3d-3952-4cd4-9020-9b8acb483105:5829:1875724595157120:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788830569.606343:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.121@tcp lock: ffff9e2540030600/0x575506951eea0d65 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea0d6c expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830569.606351:0:5829:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.121@tcp lock: ffff9e2540030600/0x575506951eea0d65 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x575506951eea0d6c expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788830569.606387:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257fa66d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1745cc3d-3952-4cd4-9020-9b8acb483105:5829:1875724595157248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788830569.606411:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830569.606423:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e24469d4000 going to sleep for 11 seconds 00000100:00100000:1.0:1788830569.606992:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595157248 00000100:00100000:1.0:1788830569.607006:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595157248 00000100:00100000:1.0:1788830569.607032:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1788830569.607039:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255d998050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1745cc3d-3952-4cd4-9020-9b8acb483105+19:5829:x1875724595157248:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788830569.607581:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255d998050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1745cc3d-3952-4cd4-9020-9b8acb483105+19:5829:x1875724595157248:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 540us (1167us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830569.607589:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1788830569.616254:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578347392 00000100:00100000:2.0:1788830569.616269:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578347392 00000100:00100000:0.0:1788830569.618615:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257fa66d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1745cc3d-3952-4cd4-9020-9b8acb483105:5829:1875724595157248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788830569.619046:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e255130b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1745cc3d-3952-4cd4-9020-9b8acb483105:5829:1875724595157376:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788830569.619139:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830569.636188:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e24452d8f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788830569.636403:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595157376 00000100:00100000:2.0:1788830569.636413:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595157376 00000100:00100000:2.0:1788830569.636614:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 266 00000100:00100000:2.0:1788830569.636698:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255d99b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+13:5593:x1875724578347392:12345-192.168.201.21@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788830569.637182:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255d99b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+13:5593:x1875724578347392:12345-192.168.201.21@tcp:501:ll_cfg_requeue.0 Request processed in 557us (35357us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830569.637202:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 266 00000100:00100000:2.0:1788830569.637240:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1788830569.638223:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255d999c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1745cc3d-3952-4cd4-9020-9b8acb483105+19:5829:x1875724595157376:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788830569.639208:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255d999c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1745cc3d-3952-4cd4-9020-9b8acb483105+19:5829:x1875724595157376:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 993us (20065us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830569.639221:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1788830569.639374:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e255130b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1745cc3d-3952-4cd4-9020-9b8acb483105:5829:1875724595157376:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788830569.640358:0:11677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e255130b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1745cc3d-3952-4cd4-9020-9b8acb483105:11677:1875724595157504:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788830569.642015:0:11677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830569.642071:0:11677:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e24452d8f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788830569.642139:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595157504 00000100:00100000:2.0:1788830569.642147:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595157504 00000100:00100000:2.0:1788830569.642200:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1788830569.642210:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255d99a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1745cc3d-3952-4cd4-9020-9b8acb483105+19:11677:x1875724595157504:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788830569.643104:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255d99a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1745cc3d-3952-4cd4-9020-9b8acb483105+19:11677:x1875724595157504:12345-0@lo:502:llog_process_th.0 Request processed in 892us (2688us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830569.643114:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1788830569.643319:0:11677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e255130b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1745cc3d-3952-4cd4-9020-9b8acb483105:11677:1875724595157504:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788830569.643357:0:11677:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788830569.643367:0:11677:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788830569.643369:0:11677:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788830569.643376:0:11677:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9e255d9b0800 00000020:00000080:0.0:1788830569.643379:0:11677:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788830569.643483:0:11677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e255130b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1745cc3d-3952-4cd4-9020-9b8acb483105:11677:1875724595157632:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788830569.643616:0:11677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830569.643860:0:11677:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e25501a73c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788830569.644597:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595157632 00000100:00100000:2.0:1788830569.644605:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595157632 00000100:00100000:2.0:1788830569.644999:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1788830569.645010:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255d998450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1745cc3d-3952-4cd4-9020-9b8acb483105+19:11677:x1875724595157632:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788830569.645272:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255d998450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1745cc3d-3952-4cd4-9020-9b8acb483105+19:11677:x1875724595157632:12345-0@lo:502:llog_process_th.0 Request processed in 264us (1655us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830569.645279:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1788830569.645434:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830569.645489:0:11677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e255130b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1745cc3d-3952-4cd4-9020-9b8acb483105:11677:1875724595157632:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788830569.645533:0:11677:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788830569.645540:0:11677:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788830569.645541:0:11677:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1788830569.645545:0:11677:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1788830569.645611:0:5829:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1788830569.645641:0:5829:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788830569.645651:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: ffff9e2540030600/0x575506951eea0d65 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea0d6c expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830569.645661:0:5829:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.121@tcp lock: ffff9e2540030600/0x575506951eea0d65 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea0d6c expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788830569.659981:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578347520 00000100:00100000:0.0:1788830569.660016:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578347520 00000100:00100000:1.0:1788830569.660174:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 270 00000100:00100000:1.0:1788830569.660184:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255d99b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+13:5593:x1875724578347520:12345-192.168.201.21@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788830569.660418:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255d99b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+13:5593:x1875724578347520:12345-192.168.201.21@tcp:503:ll_cfg_requeue.0 Request processed in 234us (14985us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830569.660440:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 270 00000040:00080000:0.0:1788830569.661925:0:11676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788830569.674880:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830569.675384:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578347648 00000100:00100000:2.0:1788830569.675396:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578347648 00000100:00100000:2.0:1788830569.675467:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 271 00000100:00100000:2.0:1788830569.675478:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255d99ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+13:9952:x1875724578347648:12345-192.168.201.21@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788830569.675815:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255d99ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+13:9952:x1875724578347648:12345-192.168.201.21@tcp:502:llog_process_th.0 Request processed in 337us (944us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830569.675828:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 271 00000100:00100000:1.0:1788830569.693417:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830569.694094:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578347776 00000100:00100000:3.0:1788830569.694106:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578347776 00000100:00100000:3.0:1788830569.694162:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 272 00000100:00100000:3.0:1788830569.694173:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255d998c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+13:9952:x1875724578347776:12345-192.168.201.21@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788830569.694465:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255d998c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+13:9952:x1875724578347776:12345-192.168.201.21@tcp:502:llog_process_th.0 Request processed in 292us (1057us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830569.694474:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 272 00010000:00010000:3.0:1788830570.524519:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788830570.716652:0:11676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788830571.228061:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788830571.228087:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e255005ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875724595157760:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788830571.228162:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788830571.229365:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595157760 00000100:00100000:2.0:1788830571.229376:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595157760 00000100:00100000:2.0:1788830571.229454:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788830571.229465:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255130b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1875724595157760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788830571.229505:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788830571.229648:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255130b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1875724595157760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 185us (1485us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830571.229655:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:0.0:1788830571.229808:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788830571.231974:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e255005ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875724595157760:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788830571.548666:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788830571.914619:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830571.914767:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830571.914807:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830571.914841:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830571.914879:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578348032 00000100:00100000:3.0:1788830571.914889:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578348032 00000100:00100000:3.0:1788830571.914961:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578348288 00000100:00100000:3.0:1788830571.914965:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578348288 00000100:00100000:3.0:1788830571.914994:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 94 00000100:00100000:3.0:1788830571.915003:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2565430700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+5:2353:x1875724578348032:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:3.0:1788830571.915077:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2565430700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+5:2353:x1875724578348032:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 74us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830571.915086:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 94 00000100:00100000:3.0:1788830571.915102:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 95 00000100:00100000:3.0:1788830571.915108:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2565431880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2154ea6-69cb-4a30-aac0-000fba13e98b+5:2353:x1875724578348288:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:3.0:1788830571.915134:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2565431880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2154ea6-69cb-4a30-aac0-000fba13e98b+5:2353:x1875724578348288:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 26us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830571.915156:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 95 00000100:00100000:0.0:1788830571.916353:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578348160 00000100:00100000:0.0:1788830571.916366:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578348160 00000100:00100000:0.0:1788830571.916441:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 57 00000100:00100000:0.0:1788830571.916450:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2565433800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+5:2353:x1875724578348160:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:0.0:1788830571.916504:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2565433800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+5:2353:x1875724578348160:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 55us (1737us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830571.916523:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 57 00000100:00080000:0.0:1788830571.916548:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788830571.916552:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788830571.919257:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578347904 00000100:00100000:2.0:1788830571.919271:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578347904 00000100:00100000:2.0:1788830571.919369:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 273 00000100:00100000:2.0:1788830571.919390:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255d99a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+13:2353:x1875724578347904:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:2.0:1788830571.919457:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255d99a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+13:2353:x1875724578347904:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 79us (4852us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830571.919462:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 273 00000100:00100000:3.0:1788830572.252009:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2547240380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875724595158016:0@lo:400:kworker.0 00000100:00100000:2.0:1788830572.252009:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e255130ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1745cc3d-3952-4cd4-9020-9b8acb483105:3307:1875724595157888:0@lo:400:kworker.0 00000100:00100000:0.0:1788830572.252112:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2445998e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1875724595158272:0@lo:400:kworker.0 00000100:00100000:1.0:1788830572.252161:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2547242300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875724595158144:0@lo:400:kworker.0 00000100:00100000:3.0:1788830572.255283:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830572.255373:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e244599a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875724595158528:0@lo:400:kworker.0 00000100:00100000:3.0:1788830572.255411:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830572.255438:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788830572.255446:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e244599b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1875724595158400:0@lo:400:kworker.0 00000100:00100000:2.0:1788830572.255465:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788830572.255549:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595158528 00000100:00100000:2.0:1788830572.255558:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595158528 00000100:00100000:0.0:1788830572.255592:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788830572.255629:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788830572.255642:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595157888 00000100:00100000:0.0:1788830572.255647:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595157888 00000100:00100000:0.0:1788830572.255686:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1788830572.255696:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255d999850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+19:3307:x1875724595157888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788830572.255767:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255d999850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+19:3307:x1875724595157888:12345-0@lo:400:kworker.0 Request processed in 72us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830572.255775:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1788830572.255815:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595158016 00000100:00100000:0.0:1788830572.255825:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595158016 00000100:00100000:2.0:1788830572.256202:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788830572.256212:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2565433100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875724595158528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788830572.256252:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2565433100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875724595158528:12345-0@lo:400:kworker.0 Request processed in 44us (840us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830572.256268:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788830572.256305:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e255130ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1745cc3d-3952-4cd4-9020-9b8acb483105:3307:1875724595157888:0@lo:400:kworker.0 00000100:00100000:2.0:1788830572.256677:0:8202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595158272 00000100:00100000:2.0:1788830572.256683:0:8202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595158272 00000100:00100000:2.0:1788830572.256737:0:8202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788830572.256902:0:8202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2565cc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875724595158272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788830572.256952:0:8202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2565cc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875724595158272:12345-0@lo:400:kworker.0 Request processed in 53us (1362us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830572.256959:0:8202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788830572.256989:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2445998e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1875724595158272:0@lo:400:kworker.0 00000100:00080000:2.0:1788830572.257039:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788830572.257318:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788830572.257329:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2565431180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875724595158016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788830572.257338:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788830572.257382:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e244599a680 x1875724595158528/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788830588 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788830572.257391:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2565431180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875724595158016:12345-0@lo:400:kworker.0 Request processed in 51us (2103us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830572.257395:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e244599a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875724595158528:0@lo:400:kworker.0 00000100:00100000:0.0:1788830572.257405:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788830572.257414:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2547240380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875724595158016:0@lo:400:kworker.0 00000100:00100000:0.0:1788830572.257421:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595158400 00000100:00100000:0.0:1788830572.257426:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595158400 00000100:00080000:3.0:1788830572.257452:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788830572.257463:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788830572.257472:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2565430380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875724595158400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788830572.257526:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2565430380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875724595158400:12345-0@lo:400:kworker.0 Request processed in 55us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830572.257533:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788830572.257558:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e244599b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1875724595158400:0@lo:400:kworker.0 00000100:00100000:1.0:1788830572.257757:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830572.258596:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595158144 00000100:00100000:3.0:1788830572.258603:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595158144 00000100:00100000:3.0:1788830572.258648:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788830572.258656:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257fa65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3309:x1875724595158144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788830572.258735:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257fa65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3309:x1875724595158144:12345-0@lo:400:kworker.0 Request processed in 54us (951us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830572.258741:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788830572.258820:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2547242300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875724595158144:0@lo:400:kworker.0 00010000:00010000:3.0:1788830572.574655:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788830572.764007:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2565432300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875724595158656:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788830572.764088:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830572.764515:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595158656 00000100:00100000:3.0:1788830572.764525:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595158656 00000100:00100000:3.0:1788830572.764600:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788830572.764610:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257fa65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875724595158656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788830572.764647:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788830572.764704:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257fa65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875724595158656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (617us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830572.764731:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:0.0:1788830572.764867:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e2565432300 x1875724595158656/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788830588 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788830572.764895:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2565432300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875724595158656:0@lo:13:osp-pre-1-0.0 00000001:00080000:0.0:1788830573.353949:0:6709:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00010000:00010000:0.0:1788830573.596840:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788830574.621678:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788830575.643959:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788830576.348208:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e255005ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875724595158784:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788830576.348330:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830576.348398:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595158784 00000100:00100000:3.0:1788830576.348410:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595158784 00000100:00080000:2.0:1788830576.348467:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788830576.348499:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788830576.348515:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2565cc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875724595158784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788830576.348562:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788830576.348622:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2565cc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875724595158784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830576.348630:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788830576.348938:0:3310:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:0.0:1788830576.348946:0:3310:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e2551309f80, transno 4294967300 00000100:00100000:0.0:1788830576.348987:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e255005ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875724595158784:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788830576.667929:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788830577.034296:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830577.034342:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830577.034412:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830577.034462:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830577.034494:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578348416 00000100:00100000:1.0:1788830577.034508:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578348416 00000100:00100000:1.0:1788830577.034584:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 275 00000100:00100000:1.0:1788830577.034598:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2574712850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+13:2354:x1875724578348416:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:1.0:1788830577.034694:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2574712850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+13:2354:x1875724578348416:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 98us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830577.034702:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 275 00000100:00100000:3.0:1788830577.034829:0:8202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578348544 00000100:00100000:3.0:1788830577.034836:0:8202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578348544 00000100:00100000:3.0:1788830577.034881:0:8202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578348800 00000100:00100000:3.0:1788830577.034884:0:8202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578348800 00000100:00100000:3.0:1788830577.034908:0:8202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 99 00000100:00100000:3.0:1788830577.034916:0:8202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2565cc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+5:2354:x1875724578348544:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:3.0:1788830577.034958:0:8202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2565cc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+5:2354:x1875724578348544:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 44us (680us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830577.034965:0:8202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 99 00000100:00100000:3.0:1788830577.034979:0:8202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 100 00000100:00100000:3.0:1788830577.034985:0:8202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2565cc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2154ea6-69cb-4a30-aac0-000fba13e98b+5:2354:x1875724578348800:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:3.0:1788830577.035019:0:8202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2565cc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2154ea6-69cb-4a30-aac0-000fba13e98b+5:2354:x1875724578348800:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 35us (677us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830577.035026:0:8202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 100 00000100:00100000:2.0:1788830577.035545:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578348672 00000100:00100000:2.0:1788830577.035550:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578348672 00000100:00100000:2.0:1788830577.035601:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 60 00000100:00100000:2.0:1788830577.035609:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2565cc2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+5:2354:x1875724578348672:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:2.0:1788830577.035668:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2565cc2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+5:2354:x1875724578348672:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 59us (1204us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830577.035675:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 60 00000100:00080000:2.0:1788830577.035694:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788830577.035699:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788830577.373280:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257fa66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875724595159040:0@lo:400:kworker.0 00000100:00100000:3.0:1788830577.373390:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830577.373494:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2566012a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875724595159552:0@lo:400:kworker.0 00000100:00100000:3.0:1788830577.373533:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830577.373568:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788830577.373574:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257fa66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1745cc3d-3952-4cd4-9020-9b8acb483105:3308:1875724595158912:0@lo:400:kworker.0 00000100:00100000:3.0:1788830577.373607:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830577.373626:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2566013100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1875724595159424:0@lo:400:kworker.0 00000100:00100000:3.0:1788830577.373650:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788830577.373924:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595159552 00000100:00100000:2.0:1788830577.373937:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595159552 00000100:00100000:2.0:1788830577.374020:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788830577.374031:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2565430a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875724595159552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788830577.374100:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2565430a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875724595159552:12345-0@lo:400:kworker.0 Request processed in 70us (565us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830577.374126:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788830577.374154:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595158912 00000100:00100000:2.0:1788830577.374158:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595158912 00000100:00100000:2.0:1788830577.374188:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1788830577.374194:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2574713c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1745cc3d-3952-4cd4-9020-9b8acb483105+19:3308:x1875724595158912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788830577.374226:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2574713c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1745cc3d-3952-4cd4-9020-9b8acb483105+19:3308:x1875724595158912:12345-0@lo:400:kworker.0 Request processed in 31us (618us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830577.374232:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1788830577.374462:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2566012d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875724595159168:0@lo:400:kworker.0 00000100:00100000:0.0:1788830577.374501:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830577.374541:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788830577.374548:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2566010e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875724595159296:0@lo:400:kworker.0 00000100:00100000:0.0:1788830577.374573:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830577.374607:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595159040 00000100:00100000:0.0:1788830577.374612:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595159040 00000100:00100000:0.0:1788830577.374640:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595159424 00000100:00100000:0.0:1788830577.374643:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595159424 00000100:00100000:0.0:1788830577.374660:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595159296 00000100:00100000:0.0:1788830577.374663:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595159296 00000100:00100000:0.0:1788830577.374679:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788830577.374685:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2565432300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875724595159040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788830577.374750:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2565432300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875724595159040:12345-0@lo:400:kworker.0 Request processed in 65us (1360us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830577.374757:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788830577.374770:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788830577.374776:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2565433480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875724595159424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788830577.374805:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2565433480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875724595159424:12345-0@lo:400:kworker.0 Request processed in 29us (1155us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830577.374811:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788830577.374822:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788830577.374827:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2565cc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875724595159296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788830577.374859:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2565cc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875724595159296:12345-0@lo:400:kworker.0 Request processed in 32us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830577.374877:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788830577.375105:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595159168 00000100:00100000:2.0:1788830577.375110:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595159168 00000100:00100000:2.0:1788830577.375139:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788830577.375146:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2565cc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875724595159168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788830577.375180:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2565cc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875724595159168:12345-0@lo:400:kworker.0 Request processed in 35us (680us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830577.375186:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:3.0:1788830577.375277:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788830577.375283:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788830577.375319:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257fa66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1745cc3d-3952-4cd4-9020-9b8acb483105:3308:1875724595158912:0@lo:400:kworker.0 00000100:00100000:3.0:1788830577.375338:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2566013100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1875724595159424:0@lo:400:kworker.0 00000100:00100000:3.0:1788830577.375350:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257fa66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875724595159040:0@lo:400:kworker.0 00010000:00080000:3.0:1788830577.375367:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e2566012a00 x1875724595159552/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788830593 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788830577.375378:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2566012a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875724595159552:0@lo:400:kworker.0 00000100:00100000:0.0:1788830577.375606:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2566010e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875724595159296:0@lo:400:kworker.0 00000100:00100000:0.0:1788830577.375619:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2566012d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875724595159168:0@lo:400:kworker.0 00010000:00010000:0.0:1788830577.696624:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788830577.884087:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2565433b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875724595159680:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788830577.884171:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830577.884310:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595159680 00000100:00100000:1.0:1788830577.884320:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595159680 00000100:00100000:1.0:1788830577.884380:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788830577.884391:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2565cc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875724595159680:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788830577.884437:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788830577.890318:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2565cc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875724595159680:12345-0@lo:13:osp-pre-1-0.0 Request processed in 5919us (6136us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830577.890334:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:0.0:1788830577.890675:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e2565433b80 x1875724595159680/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788830593 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788830577.890701:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2565433b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875724595159680:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788830578.715843:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788830579.745109:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788830580.765768:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788830580.957082:0:11676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788830581.468921:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788830581.468974:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e255005ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875724595159808:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788830581.469078:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788830581.469416:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595159808 00000100:00100000:2.0:1788830581.469428:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595159808 00000100:00100000:2.0:1788830581.469531:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788830581.469552:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2565432d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875724595159808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788830581.469613:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1788830581.469984:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788830581.470143:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2565432d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875724595159808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 593us (1063us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830581.470151:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788830581.470259:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e255005ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875724595159808:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788830581.793266:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788830582.154825:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830582.154872:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830582.154908:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830582.154947:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830582.154972:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578349056 00000100:00100000:0.0:1788830582.154982:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578349056 00000100:00100000:0.0:1788830582.155033:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578349312 00000100:00100000:0.0:1788830582.155035:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578349312 00000100:00100000:0.0:1788830582.155069:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 104 00000100:00100000:0.0:1788830582.155078:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2565cc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+5:2355:x1875724578349056:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:0.0:1788830582.155149:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2565cc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+5:2355:x1875724578349056:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 72us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830582.155156:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 104 00000100:00100000:0.0:1788830582.155170:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 105 00000100:00100000:0.0:1788830582.155189:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2565cc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2154ea6-69cb-4a30-aac0-000fba13e98b+5:2355:x1875724578349312:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:0.0:1788830582.155211:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2565cc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2154ea6-69cb-4a30-aac0-000fba13e98b+5:2355:x1875724578349312:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 23us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830582.155229:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 105 00000100:00100000:1.0:1788830582.155323:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578348928 00000100:00100000:1.0:1788830582.155328:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578348928 00000100:00100000:1.0:1788830582.155402:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 277 00000100:00100000:1.0:1788830582.155409:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2574711050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+13:2355:x1875724578348928:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:1.0:1788830582.155436:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2574711050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+13:2355:x1875724578348928:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 28us (625us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830582.155449:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 277 00000100:00100000:3.0:1788830582.156022:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578349184 00000100:00100000:3.0:1788830582.156038:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578349184 00000100:00100000:3.0:1788830582.156077:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 63 00000100:00100000:3.0:1788830582.156085:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2565cc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+5:2355:x1875724578349184:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:3.0:1788830582.156121:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2565cc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+5:2355:x1875724578349184:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 37us (1248us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830582.156128:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 63 00000100:00080000:0.0:1788830582.156376:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788830582.156381:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788830582.492082:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2565cc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1875724595160320:0@lo:400:kworker.0 00000100:00100000:0.0:1788830582.492160:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830582.492233:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788830582.492240:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2565cc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875724595160192:0@lo:400:kworker.0 00000100:00100000:0.0:1788830582.492290:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830582.492327:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595160320 00000100:00100000:0.0:1788830582.492347:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595160320 00000100:00100000:0.0:1788830582.492412:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788830582.492423:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2565cc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875724595160320:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788830582.492451:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788830582.492478:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2565cc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875724595160320:12345-0@lo:400:kworker.0 Request processed in 58us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830582.492485:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788830582.492506:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2565cc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1875724595160320:0@lo:400:kworker.0 00000100:00100000:3.0:1788830582.492651:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2565cc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875724595160064:0@lo:400:kworker.0 00000100:00100000:3.0:1788830582.492683:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830582.492737:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2565cc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875724595160576:0@lo:400:kworker.0 00000100:00100000:3.0:1788830582.492762:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830582.492796:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788830582.492803:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2565cc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1745cc3d-3952-4cd4-9020-9b8acb483105:3308:1875724595159936:0@lo:400:kworker.0 00000100:00100000:3.0:1788830582.492833:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830582.492853:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2565cc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1875724595160448:0@lo:400:kworker.0 00000100:00100000:3.0:1788830582.492877:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830582.492947:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595160192 00000100:00100000:1.0:1788830582.492953:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595160192 00000100:00100000:1.0:1788830582.492989:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595160576 00000100:00100000:1.0:1788830582.492993:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595160576 00000100:00100000:1.0:1788830582.493020:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788830582.493027:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25747c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875724595160192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788830582.493067:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25747c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875724595160192:12345-0@lo:400:kworker.0 Request processed in 41us (778us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830582.493074:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788830582.493089:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788830582.493095:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2565430000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875724595160576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788830582.493127:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2565430000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875724595160576:12345-0@lo:400:kworker.0 Request processed in 31us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830582.493132:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:1.0:1788830582.493146:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788830582.493165:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e2565cc0380 x1875724595160576/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788830598 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788830582.493176:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2565cc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875724595160576:0@lo:400:kworker.0 00000100:00100000:1.0:1788830582.493199:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2565cc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875724595160192:0@lo:400:kworker.0 00000100:00100000:2.0:1788830582.493440:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595159936 00000100:00100000:2.0:1788830582.493445:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595159936 00000100:00100000:2.0:1788830582.493491:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1788830582.493498:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2574713850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+19:3308:x1875724595159936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788830582.493546:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2574713850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+19:3308:x1875724595159936:12345-0@lo:400:kworker.0 Request processed in 49us (712us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830582.493553:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1788830582.493581:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595160064 00000100:00100000:2.0:1788830582.493585:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595160064 00000100:00100000:2.0:1788830582.493603:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595160448 00000100:00100000:2.0:1788830582.493606:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595160448 00000100:00100000:2.0:1788830582.493631:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788830582.493651:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2565432a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875724595160064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788830582.493682:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2565432a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875724595160064:12345-0@lo:400:kworker.0 Request processed in 33us (998us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830582.493688:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788830582.493700:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788830582.493706:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2565433b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875724595160448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788830582.493765:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2565433b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875724595160448:12345-0@lo:400:kworker.0 Request processed in 59us (886us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830582.493771:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788830582.493898:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2565cc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1745cc3d-3952-4cd4-9020-9b8acb483105:3308:1875724595159936:0@lo:400:kworker.0 00000100:00100000:3.0:1788830582.493909:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2565cc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1875724595160448:0@lo:400:kworker.0 00000100:00100000:3.0:1788830582.493917:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2565cc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875724595160064:0@lo:400:kworker.0 00000100:00080000:1.0:1788830582.493983:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788830582.811875:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788830583.004209:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257fa66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875724595160704:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788830583.004296:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830583.004665:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595160704 00000100:00100000:3.0:1788830583.004676:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595160704 00000100:00100000:3.0:1788830583.004754:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788830583.004765:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2566010a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875724595160704:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788830583.004802:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788830583.004858:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2566010a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875724595160704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830583.004865:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:1.0:1788830583.005026:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e257fa66d80 x1875724595160704/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788830599 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788830583.005044:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257fa66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875724595160704:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788830583.836007:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788830584.860993:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788830585.884523:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788830586.588163:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788830586.588199:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e255005f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875724595160832:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788830586.588302:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788830586.588527:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595160832 00000100:00100000:2.0:1788830586.588537:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595160832 00000100:00100000:2.0:1788830586.588628:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788830586.588639:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257fa66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875724595160832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788830586.588685:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788830586.588786:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257fa66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875724595160832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 149us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830586.588794:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:3.0:1788830586.589079:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788830586.589121:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e255005f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875724595160832:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788830586.908017:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788830587.270067:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830587.270191:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578349440 00000100:00100000:2.0:1788830587.270201:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578349440 00000100:00100000:2.0:1788830587.270271:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 279 00000100:00100000:2.0:1788830587.270282:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2574711c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+13:2355:x1875724578349440:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:2.0:1788830587.270359:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2574711c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+13:2355:x1875724578349440:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 78us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830587.270367:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 279 00000100:00100000:0.0:1788830587.287658:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830587.287914:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578349568 00000100:00100000:2.0:1788830587.287924:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578349568 00000100:00100000:2.0:1788830587.288048:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 109 00000100:00100000:2.0:1788830587.288060:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25747c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+5:2355:x1875724578349568:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:2.0:1788830587.289074:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25747c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+5:2355:x1875724578349568:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 1012us (1422us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830587.289085:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 109 00000100:00080000:3.0:1788830587.291905:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788830587.295640:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830587.295697:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830587.296426:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578349696 00000100:00100000:2.0:1788830587.296438:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578349696 00000100:00100000:2.0:1788830587.296526:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 21 00000100:00100000:2.0:1788830587.296537:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2547242300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+5:2351:x1875724578349696:12345-192.168.201.21@tcp:9:kworker.0 00000020:00000080:2.0:1788830587.296569:0:6677:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x575506951eea0ca8 00000100:00080000:2.0:1788830587.296579:0:6677:0:(import.c:65:import_set_state_nolock()) ffff9e2547358800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788830587.296622:0:6677:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967300 00000100:00080000:3.0:1788830587.296925:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788830587.296949:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788830587.297448:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2547242300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+2:2351:x1875724578349696:12345-192.168.201.21@tcp:9:kworker.0 Request processed in 910us (1747us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830587.297458:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 21 00000100:00100000:1.0:1788830587.297874:0:8202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578349824 00000100:00100000:1.0:1788830587.297881:0:8202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578349824 00000100:00100000:1.0:1788830587.297936:0:8202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 110 00000100:00100000:1.0:1788830587.297944:0:8202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257fa66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2154ea6-69cb-4a30-aac0-000fba13e98b+5:2355:x1875724578349824:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:1.0:1788830587.297998:0:8202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257fa66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2154ea6-69cb-4a30-aac0-000fba13e98b+5:2355:x1875724578349824:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 54us (2370us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830587.298006:0:8202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 110 00000100:00080000:3.0:1788830587.298884:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788830587.612084:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25747c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1875724595161344:0@lo:400:kworker.0 00000100:00100000:1.0:1788830587.612095:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25747c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875724595161216:0@lo:400:kworker.0 00000100:00100000:0.0:1788830587.612161:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830587.612257:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595161344 00000100:00100000:0.0:1788830587.612265:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595161344 00000100:00100000:0.0:1788830587.612403:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788830587.612428:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25747c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875724595161344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788830587.612455:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830587.612496:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595161216 00000100:00100000:1.0:1788830587.612501:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595161216 00000100:00100000:1.0:1788830587.612531:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788830587.612539:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2566011500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875724595161216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788830587.612566:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25747c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875724595161344:12345-0@lo:400:kworker.0 Request processed in 139us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830587.612575:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788830587.612586:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2566011500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875724595161216:12345-0@lo:400:kworker.0 Request processed in 47us (131us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830587.612595:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788830587.612624:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25747c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1875724595161344:0@lo:400:kworker.0 00000100:00100000:1.0:1788830587.612632:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25747c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875724595161216:0@lo:400:kworker.0 00000100:00080000:0.0:1788830587.612652:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788830587.612735:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25747c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1745cc3d-3952-4cd4-9020-9b8acb483105:3307:1875724595160960:0@lo:400:kworker.0 00000100:00100000:2.0:1788830587.612774:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788830587.612897:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25747c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1875724595161472:0@lo:400:kworker.0 00000100:00100000:2.0:1788830587.612926:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788830587.612955:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788830587.612961:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25747c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875724595161088:0@lo:400:kworker.0 00000100:00100000:2.0:1788830587.612984:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788830587.613000:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25747c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875724595161600:0@lo:400:kworker.0 00000100:00100000:2.0:1788830587.613022:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830587.613091:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595161472 00000100:00100000:0.0:1788830587.613095:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595161472 00000100:00100000:0.0:1788830587.613134:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595161088 00000100:00100000:0.0:1788830587.613137:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595161088 00000100:00100000:0.0:1788830587.613156:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788830587.613162:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255005ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875724595161472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788830587.613201:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255005ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875724595161472:12345-0@lo:400:kworker.0 Request processed in 39us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830587.613207:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788830587.613220:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788830587.613225:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255005d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875724595161088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788830587.613264:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255005d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875724595161088:12345-0@lo:400:kworker.0 Request processed in 38us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830587.613270:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788830587.613289:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595161600 00000100:00100000:0.0:1788830587.613292:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595161600 00000100:00080000:2.0:1788830587.613602:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788830587.613606:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788830587.613661:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25747c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875724595161088:0@lo:400:kworker.0 00000100:00100000:2.0:1788830587.613671:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25747c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1875724595161472:0@lo:400:kworker.0 00000100:00100000:0.0:1788830587.613740:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788830587.613752:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255005e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875724595161600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788830587.614256:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595160960 00000100:00100000:1.0:1788830587.614262:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595160960 00000100:00100000:1.0:1788830587.614310:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:1.0:1788830587.614317:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2574712450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1745cc3d-3952-4cd4-9020-9b8acb483105+19:3307:x1875724595160960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788830587.614390:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255005e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875724595161600:12345-0@lo:400:kworker.0 Request processed in 641us (1367us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830587.614406:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788830587.614441:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2574712450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1745cc3d-3952-4cd4-9020-9b8acb483105+19:3307:x1875724595160960:12345-0@lo:400:kworker.0 Request processed in 124us (1665us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830587.614449:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00010000:00080000:2.0:1788830587.618562:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e25747c2a00 x1875724595161600/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788830603 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788830587.618583:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25747c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875724595161600:0@lo:400:kworker.0 00000100:00100000:2.0:1788830587.618599:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25747c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1745cc3d-3952-4cd4-9020-9b8acb483105:3307:1875724595160960:0@lo:400:kworker.0 00010000:00010000:3.0:1788830587.931893:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788830588.124171:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788830588.124196:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2547240380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875724595161728:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788830588.124283:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830588.124550:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595161728 00000100:00100000:3.0:1788830588.124558:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595161728 00000100:00100000:3.0:1788830588.124608:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788830588.124616:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25747c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875724595161728:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788830588.124650:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788830588.124703:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25747c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875724595161728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830588.124750:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:0.0:1788830588.124841:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e2547240380 x1875724595161728/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788830604 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788830588.124859:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2547240380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875724595161728:0@lo:13:osp-pre-1-0.0 00000001:00100000:0.0:1788830588.737478:0:6709:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 1ef2fe7a-e5ec-4085-8326-b72aa00876cd 00000020:00000080:0.0:1788830588.737487:0:6709:0:(genops.c:885:class_export_put()) final put ffff9e2547358000/1ef2fe7a-e5ec-4085-8326-b72aa00876cd 00000020:00000080:2.0:1788830588.737531:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e2547358000/1ef2fe7a-e5ec-4085-8326-b72aa00876cd for lustre-OST0000 00000020:00000080:2.0:1788830588.737576:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e2547358800 for lustre-OST0000 00010000:00010000:3.0:1788830588.956398:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788830589.987605:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788830590.179810:0:11676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788830591.003893:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788830591.708375:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788830591.708412:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e255005f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875724595161856:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788830591.708509:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830591.708669:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595161856 00000100:00100000:3.0:1788830591.708681:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595161856 00000100:00100000:3.0:1788830591.708800:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788830591.708813:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2566012680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875724595161856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788830591.708860:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1788830591.709064:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788830591.709221:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2566012680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875724595161856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 410us (712us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830591.709230:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788830591.709359:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e255005f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875724595161856:0@lo:13:osp-pre-0-0.0 00000001:02000400:2.0:1788830591.956697:0:11844:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 21:23:10 (1788830590) 00010000:00010000:1.0:1788830592.038120:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788830592.391511:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830592.391577:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830592.391620:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830592.391760:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578349952 00000100:00100000:2.0:1788830592.391774:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578349952 00000100:00100000:2.0:1788830592.391837:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 281 00000100:00100000:2.0:1788830592.391848:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2574710450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+13:2353:x1875724578349952:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:2.0:1788830592.391934:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2574710450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+13:2353:x1875724578349952:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 89us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830592.391959:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 281 00000100:00100000:3.0:1788830592.392069:0:8202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578350208 00000100:00100000:3.0:1788830592.392074:0:8202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578350208 00000100:00100000:3.0:1788830592.392129:0:8202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578350080 00000100:00100000:3.0:1788830592.392132:0:8202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578350080 00000100:00100000:3.0:1788830592.392152:0:8202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 114 00000100:00100000:3.0:1788830592.392159:0:8202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25747c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2154ea6-69cb-4a30-aac0-000fba13e98b+5:2353:x1875724578350208:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:3.0:1788830592.392203:0:8202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25747c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2154ea6-69cb-4a30-aac0-000fba13e98b+5:2353:x1875724578350208:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 45us (626us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830592.392209:0:8202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 114 00000100:00100000:3.0:1788830592.392222:0:8202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 115 00000100:00100000:3.0:1788830592.392227:0:8202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25747c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+5:2353:x1875724578350080:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:3.0:1788830592.392248:0:8202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25747c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+5:2353:x1875724578350080:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 21us (628us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830592.392253:0:8202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 115 00000100:00080000:2.0:1788830592.392504:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788830592.732328:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e255005c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1745cc3d-3952-4cd4-9020-9b8acb483105:3307:1875724595161984:0@lo:400:kworker.0 00000100:00100000:0.0:1788830592.732443:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830592.732656:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595161984 00000100:00100000:1.0:1788830592.732677:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595161984 00000100:00100000:1.0:1788830592.732812:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:1.0:1788830592.732825:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2574713450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1745cc3d-3952-4cd4-9020-9b8acb483105+19:3307:x1875724595161984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788830592.733168:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e255005f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875724595162112:0@lo:400:kworker.0 00000100:00100000:3.0:1788830592.733237:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830592.733309:0:8202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595162112 00000100:00100000:3.0:1788830592.733314:0:8202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595162112 00000100:00100000:3.0:1788830592.733351:0:8202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788830592.733359:0:8202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2547240380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875724595162112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788830592.733401:0:8202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2547240380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875724595162112:12345-0@lo:400:kworker.0 Request processed in 42us (164us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830592.733408:0:8202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788830592.733462:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e255005f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875724595162112:0@lo:400:kworker.0 00000100:00100000:1.0:1788830592.740294:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2574713450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1745cc3d-3952-4cd4-9020-9b8acb483105+19:3307:x1875724595161984:12345-0@lo:400:kworker.0 Request processed in 7459us (7838us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830592.740309:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:0.0:1788830592.741481:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e255005c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1745cc3d-3952-4cd4-9020-9b8acb483105:3307:1875724595161984:0@lo:400:kworker.0 00000100:00100000:2.0:1788830592.743552:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e255005c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875724595162624:0@lo:400:kworker.0 00000100:00100000:0.0:1788830592.743552:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e255005ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1875724595162368:0@lo:400:kworker.0 00000100:00100000:1.0:1788830592.743556:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e255005f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875724595162240:0@lo:400:kworker.0 00000100:00100000:3.0:1788830592.743656:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e255005ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1875724595162496:0@lo:400:kworker.0 00000100:00100000:0.0:1788830592.745610:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830592.746037:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595162368 00000100:00100000:0.0:1788830592.746052:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595162368 00000100:00100000:0.0:1788830592.746131:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788830592.746144:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25747c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875724595162368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788830592.746243:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25747c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875724595162368:12345-0@lo:400:kworker.0 Request processed in 102us (645us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830592.746270:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788830592.746356:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788830592.746474:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595162624 00000100:00100000:2.0:1788830592.746486:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595162624 00000100:00100000:2.0:1788830592.746552:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00080000:0.0:1788830592.746557:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788830592.746568:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255005f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875724595162624:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788830592.746569:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788830592.746634:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e255005ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1875724595162368:0@lo:400:kworker.0 00000100:00100000:2.0:1788830592.746662:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255005f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875724595162624:12345-0@lo:400:kworker.0 Request processed in 96us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830592.746673:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788830592.750781:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830592.750954:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830592.751894:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595162240 00000100:00100000:1.0:1788830592.751906:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595162240 00000100:00100000:1.0:1788830592.751963:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788830592.751973:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2566012d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875724595162240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788830592.752055:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2566012d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875724595162240:12345-0@lo:400:kworker.0 Request processed in 83us (1281us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830592.752062:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788830592.752116:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e255005f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875724595162240:0@lo:400:kworker.0 00010000:00080000:2.0:1788830592.752493:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e255005c380 x1875724595162624/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788830608 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788830592.752505:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e255005c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875724595162624:0@lo:400:kworker.0 00000100:00100000:2.0:1788830592.752541:0:8202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595162496 00000100:00100000:2.0:1788830592.752545:0:8202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595162496 00000100:00100000:3.0:1788830592.752811:0:8202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788830592.752821:0:8202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25479a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875724595162496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788830592.752890:0:8202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25479a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875724595162496:12345-0@lo:400:kworker.0 Request processed in 71us (1936us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830592.752897:0:8202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788830592.753015:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e255005ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1875724595162496:0@lo:400:kworker.0 00000100:00080000:1.0:1788830592.753211:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788830593.051882:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788830593.245540:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788830593.245569:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25479a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875724595162752:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788830593.245666:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788830593.245851:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595162752 00000100:00100000:2.0:1788830593.245860:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595162752 00000100:00100000:2.0:1788830593.245916:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788830593.245926:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25747c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875724595162752:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788830593.245963:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788830593.246018:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25747c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875724595162752:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830593.246026:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:0.0:1788830593.246127:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e25479a3480 x1875724595162752/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788830609 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788830593.246157:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25479a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875724595162752:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788830593.554110:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830593.554198:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578350336 00000100:00100000:0.0:1788830593.554210:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578350336 00000100:00100000:0.0:1788830593.554279:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 32 00000100:00100000:0.0:1788830593.554292:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255005ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+5:10222:x1875724578350336:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788830593.554313:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788830593.554336:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ec00/0x575506951eea0d73 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa578910534661cc0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830593.554401:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea0d7a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830593.554415:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea0d7a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830593.554429:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea0d7a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788830593.554493:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788830593.554497:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788830593.554537:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea0d7a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830593.554561:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ec00/0x575506951eea0d73 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661cc0 expref: 7 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830593.554579:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea0d7a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661cc0 expref: 6 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830593.554587:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e25518dce00) 00010000:00010000:0.0:1788830593.554589:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788830593.554593:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2445b7f800, rc 0) 00000100:00100000:0.0:1788830593.554655:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255005ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+6:10222:x1875724578350336:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 Request processed in 365us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830593.554661:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 32 00000100:00100000:3.0:1788830593.565262:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830593.565471:0:8202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578350464 00000100:00100000:0.0:1788830593.565482:0:8202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578350464 00000100:00100000:0.0:1788830593.565546:0:8202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 33 00000100:00100000:0.0:1788830593.565557:0:8202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25479a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+6:10223:x1875724578350464:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788830593.565579:0:8202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788830593.565601:0:8202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ec00/0x575506951eea0d81 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa578910534661cc7 expref: -99 pid: 8202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830593.565669:0:8202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e200/0x575506951eea0d88 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830593.565697:0:8202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e200/0x575506951eea0d88 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830593.565739:0:8202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e200/0x575506951eea0d88 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830593.565758:0:8202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea0d8f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830593.565766:0:8202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea0d8f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830593.565774:0:8202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea0d8f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830593.566010:0:8202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7fc00/0x575506951eea0d96 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830593.566019:0:8202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7fc00/0x575506951eea0d96 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830593.566027:0:8202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7fc00/0x575506951eea0d96 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788830593.566051:0:8202:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788830593.566055:0:8202:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788830593.566285:0:8202:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7fc00/0x575506951eea0d96 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830593.566300:0:8202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e200/0x575506951eea0d88 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830593.566316:0:8202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e200/0x575506951eea0d88 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830593.566323:0:8202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e200/0x575506951eea0d88 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830593.566329:0:8202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2445b7e200 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:0.0:1788830593.566333:0:8202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e200/0x575506951eea0d88 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830593.566341:0:8202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e200/0x575506951eea0d88 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830593.566354:0:8202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e25518dce00) 00010000:00010000:0.0:1788830593.566357:0:8202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788830593.566362:0:8202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e200/0x575506951eea0d88 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830593.566368:0:8202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e200/0x575506951eea0d88 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830593.566380:0:8202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea0d8f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830593.566386:0:8202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea0d8f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830593.566392:0:8202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea0d8f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830593.566397:0:8202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2445b7ee00 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:0.0:1788830593.566405:0:8202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea0d8f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830593.566411:0:8202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea0d8f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830593.566419:0:8202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9e25518dc300) 00010000:00010000:0.0:1788830593.566422:0:8202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788830593.566424:0:8202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea0d8f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830593.566431:0:8202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea0d8f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830593.566505:0:8202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ec00/0x575506951eea0d81 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661cc7 expref: 8 pid: 8202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830593.566519:0:8202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7fc00/0x575506951eea0d96 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661cc7 expref: 7 pid: 8202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830593.566527:0:8202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9e25518dca00) 00010000:00010000:0.0:1788830593.566529:0:8202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788830593.566530:0:8202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2445b7fc00, rc 0) 00000100:00100000:0.0:1788830593.566603:0:8202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25479a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+7:10223:x1875724578350464:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 Request processed in 1047us (1351us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830593.566611:0:8202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 33 00000100:00100000:3.0:1788830593.572450:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830593.572573:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578350720 00000100:00100000:1.0:1788830593.572583:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578350720 00000100:00100000:1.0:1788830593.572643:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 34 00000100:00100000:1.0:1788830593.572654:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25479a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+7:10223:x1875724578350720:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788830593.572674:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788830593.572697:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2540030a00/0x575506951eea0d9d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa578910534661cce expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830593.572798:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffe00/0x575506951eea0da4 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830593.572813:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffe00/0x575506951eea0da4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830593.572825:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffe00/0x575506951eea0da4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830593.572841:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffa00/0x575506951eea0dab lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830593.572848:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffa00/0x575506951eea0dab lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830593.572855:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffa00/0x575506951eea0dab lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830593.573240:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff200/0x575506951eea0db2 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830593.573251:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff200/0x575506951eea0db2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830593.573268:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff200/0x575506951eea0db2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788830593.573279:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:1.0:1788830593.573429:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffe00/0x575506951eea0da4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830593.573437:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffe00/0x575506951eea0da4 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830593.573451:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffe00/0x575506951eea0da4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830593.573457:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e25820ffe00 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:1.0:1788830593.573462:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffe00/0x575506951eea0da4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830593.573468:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffe00/0x575506951eea0da4 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830593.573482:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9e25518dca00) 00010000:00010000:1.0:1788830593.573485:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788830593.573490:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffe00/0x575506951eea0da4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830593.573497:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffe00/0x575506951eea0da4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830593.573508:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffa00/0x575506951eea0dab lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830593.573514:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffa00/0x575506951eea0dab lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830593.573526:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffa00/0x575506951eea0dab lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830593.573531:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e25820ffa00 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:1.0:1788830593.573534:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffa00/0x575506951eea0dab lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830593.573540:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffa00/0x575506951eea0dab lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830593.573548:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9e257480c000) 00010000:00010000:1.0:1788830593.573551:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788830593.573553:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffa00/0x575506951eea0dab lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830593.573559:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffa00/0x575506951eea0dab lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830593.574057:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2540030a00/0x575506951eea0d9d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661cce expref: 10 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830593.574073:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff200/0x575506951eea0db2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661cce expref: 9 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830593.574082:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e257480cd00) 00010000:00010000:1.0:1788830593.574085:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788830593.574087:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e25820ff200, rc 0) 00000100:00100000:1.0:1788830593.574174:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25479a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+9:10223:x1875724578350720:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 Request processed in 1520us (1751us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1788830593.574192:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 34 00000100:00100000:2.0:1788830593.580654:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830593.580773:0:8202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578350848 00000100:00100000:0.0:1788830593.580784:0:8202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578350848 00000100:00100000:0.0:1788830593.580849:0:8202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 35 00000100:00100000:0.0:1788830593.580860:0:8202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255005c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+9:10223:x1875724578350848:12345-192.168.201.21@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1788830593.580991:0:8202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255005c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+9:10223:x1875724578350848:12345-192.168.201.21@tcp:59:lhsmtool_posix.0 Request processed in 132us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830593.581000:0:8202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 35 00000001:00080000:0.0:1788830593.802223:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967309 is committed 00010000:00010000:1.0:1788830594.082293:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788830594.269306:0:11676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788830595.100215:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788830595.434049:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830595.438170:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578350976 00000100:00100000:1.0:1788830595.438182:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578350976 00000100:00100000:1.0:1788830595.438308:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 36 00000100:00100000:1.0:1788830595.438317:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255005f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+8:10265:x1875724578350976:12345-192.168.201.21@tcp:101:lfs.0 00010000:00010000:1.0:1788830595.438337:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788830595.438359:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff400/0x575506951eea0dc0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa578910534661cd5 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830595.438422:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea0dc7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830595.438434:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea0dc7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830595.438442:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea0dc7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830595.438451:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe800/0x575506951eea0dce lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830595.438455:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe800/0x575506951eea0dce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830595.438459:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe800/0x575506951eea0dce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830595.438617:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea0dc7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830595.438881:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea0dc7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830595.438888:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea0dc7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830595.438894:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e25820fe400 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:1.0:1788830595.438898:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea0dc7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830595.438907:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea0dc7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830595.438921:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e25518dce00) 00010000:00010000:1.0:1788830595.438923:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788830595.438927:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea0dc7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830595.438931:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea0dc7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830595.438939:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe800/0x575506951eea0dce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830595.438943:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe800/0x575506951eea0dce lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830595.438947:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe800/0x575506951eea0dce lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830595.438950:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e25820fe800 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:1.0:1788830595.438957:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe800/0x575506951eea0dce lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830595.438961:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe800/0x575506951eea0dce lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830595.438976:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9e257480c000) 00010000:00010000:1.0:1788830595.438978:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788830595.438980:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe800/0x575506951eea0dce lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830595.438984:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe800/0x575506951eea0dce lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830595.439013:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff400/0x575506951eea0dc0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661cd5 expref: 9 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830595.439020:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e25518dce00) 00010000:00010000:1.0:1788830595.439022:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788830595.439024:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff400/0x575506951eea0dc0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661cd5 expref: 9 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830595.439030:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e25820ff400, rc 0) 00000100:00100000:1.0:1788830595.439141:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255005f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+8:10265:x1875724578350976:12345-192.168.201.21@tcp:101:lfs.0 Request processed in 824us (5099us total) trans 0 rc 301/301 00000100:00100000:1.0:1788830595.439149:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 36 00000100:00080000:0.0:1788830595.439307:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788830595.445970:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830595.446045:0:8202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578351232 00000100:00100000:0.0:1788830595.446053:0:8202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578351232 00000100:00100000:0.0:1788830595.446107:0:8202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 37 00000100:00100000:0.0:1788830595.446126:0:8202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2566010e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+8:10265:x1875724578351232:12345-192.168.201.21@tcp:36:lfs.0 00010000:00010000:0.0:1788830595.446179:0:8202:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788830595.446202:0:8202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea0d7a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661cc0 expref: 8 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830595.446214:0:8202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e25518dce00) 00010000:00010000:0.0:1788830595.446221:0:8202:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788830595.446403:0:8202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f000/0x575506951eea0dd5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830595.446414:0:8202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f000/0x575506951eea0dd5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830595.446421:0:8202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f000/0x575506951eea0dd5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830595.446429:0:8202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e400/0x575506951eea0ddc lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830595.446433:0:8202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e400/0x575506951eea0ddc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830595.446445:0:8202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e400/0x575506951eea0ddc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788830595.447320:0:8202:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1788830595.447331:0:8202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f000/0x575506951eea0dd5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830595.447338:0:8202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f000/0x575506951eea0dd5 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830595.447346:0:8202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f000/0x575506951eea0dd5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830595.447351:0:8202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2445b7f000 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:0.0:1788830595.447356:0:8202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f000/0x575506951eea0dd5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830595.447363:0:8202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f000/0x575506951eea0dd5 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830595.447376:0:8202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e25518dc500) 00010000:00010000:0.0:1788830595.447379:0:8202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788830595.447383:0:8202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f000/0x575506951eea0dd5 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830595.447390:0:8202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f000/0x575506951eea0dd5 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788830595.447402:0:8202:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008a2cdad9 reply state 000000008225c897 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e400/0x575506951eea0ddc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788830595.447416:0:8202:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788830595.447545:0:8202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2566010e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+9:10265:x1875724578351232:12345-192.168.201.21@tcp:36:lfs.0 Request processed in 1419us (1579us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1788830595.447550:0:8202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 37 00010000:00010000:0.0:1788830595.453008:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e400/0x575506951eea0ddc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830595.453023:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e400/0x575506951eea0ddc lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830595.453028:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e400/0x575506951eea0ddc lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830595.453032:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2445b7e400 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:0.0:1788830595.453037:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e400/0x575506951eea0ddc lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830595.453042:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e400/0x575506951eea0ddc lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830595.453056:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9e25518dc900) 00010000:00010000:0.0:1788830595.453058:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788830595.453061:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e400/0x575506951eea0ddc lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830595.453064:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e400/0x575506951eea0ddc lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788830595.568398:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830595.568588:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578351360 00000100:00100000:3.0:1788830595.568599:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578351360 00000100:00100000:3.0:1788830595.568777:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 38 00000100:00100000:3.0:1788830595.568789:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2566012a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+8:10273:x1875724578351360:12345-192.168.201.21@tcp:101:lctl.0 00010000:00010000:3.0:1788830595.568815:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788830595.568840:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d80e800/0x575506951eea0de3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa578910534661cdc expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830595.568920:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d80e600/0x575506951eea0dea lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830595.568934:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d80e600/0x575506951eea0dea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830595.568947:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d80e600/0x575506951eea0dea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788830595.568983:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788830595.568987:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788830595.569024:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d80e600/0x575506951eea0dea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830595.569243:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d80e800/0x575506951eea0de3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661cdc expref: 10 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830595.569266:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d80e600/0x575506951eea0dea lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661cdc expref: 9 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830595.569275:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e25530b0200) 00010000:00010000:3.0:1788830595.569278:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788830595.569281:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e257d80e600, rc 0) 00000100:00100000:2.0:1788830595.569541:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2566012a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+9:10273:x1875724578351360:12345-192.168.201.21@tcp:101:lctl.0 Request processed in 752us (1154us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830595.569549:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 38 00000100:00100000:3.0:1788830595.641762:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830595.641996:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578351488 00000100:00100000:0.0:1788830595.642007:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578351488 00000100:00100000:0.0:1788830595.642130:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 39 00000100:00100000:0.0:1788830595.642142:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25479a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+9:10279:x1875724578351488:12345-192.168.201.21@tcp:101:bash.0 00010000:00010000:0.0:1788830595.642164:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788830595.642187:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e400/0x575506951eea0df1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa578910534661ce3 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830595.642259:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f000/0x575506951eea0df8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830595.642275:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f000/0x575506951eea0df8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830595.642287:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f000/0x575506951eea0df8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830595.642313:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea0dff lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830595.642320:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea0dff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830595.642326:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea0dff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830595.642432:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e800/0x575506951eea0e06 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830595.642441:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e800/0x575506951eea0e06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830595.642448:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e800/0x575506951eea0e06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788830595.642485:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1788830595.642488:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788830595.642523:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e800/0x575506951eea0e06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830595.642535:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f000/0x575506951eea0df8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830595.642541:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f000/0x575506951eea0df8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830595.642548:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f000/0x575506951eea0df8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830595.642554:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2445b7f000 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:0.0:1788830595.642558:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f000/0x575506951eea0df8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830595.642565:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f000/0x575506951eea0df8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830595.642577:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e25530b0200) 00010000:00010000:0.0:1788830595.642579:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788830595.642583:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f000/0x575506951eea0df8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830595.642589:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f000/0x575506951eea0df8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830595.642600:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea0dff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830595.642614:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea0dff lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830595.642620:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea0dff lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830595.642625:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2445b7f800 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:0.0:1788830595.642628:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea0dff lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830595.642633:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea0dff lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830595.642639:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9e25518dc900) 00010000:00010000:0.0:1788830595.642641:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788830595.642644:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea0dff lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830595.642649:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea0dff lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830595.642677:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e400/0x575506951eea0df1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661ce3 expref: 11 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830595.642689:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e800/0x575506951eea0e06 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661ce3 expref: 10 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830595.642695:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e25518dc500) 00010000:00010000:0.0:1788830595.642697:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788830595.642703:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2445b7e800, rc 0) 00000100:00100000:0.0:1788830595.642824:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25479a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+10:10279:x1875724578351488:12345-192.168.201.21@tcp:101:bash.0 Request processed in 685us (1118us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830595.642831:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 39 00000100:00100000:2.0:1788830595.646686:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830595.646980:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578351744 00000100:00100000:1.0:1788830595.647060:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578351744 00000100:00100000:1.0:1788830595.647179:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 40 00000100:00100000:1.0:1788830595.647190:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255005ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+10:10279:x1875724578351744:12345-192.168.201.21@tcp:101:bash.0 00010000:00010000:1.0:1788830595.647211:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788830595.647232:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff400/0x575506951eea0e0d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa578910534661cea expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830595.647377:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe800/0x575506951eea0e14 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830595.647391:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe800/0x575506951eea0e14 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830595.647404:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe800/0x575506951eea0e14 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830595.647452:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea0e1b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830595.647461:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea0e1b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830595.647468:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea0e1b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788830595.648251:0:5832:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:1.0:1788830595.648434:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea0e22 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830595.648446:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea0e22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830595.648455:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea0e22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830595.648498:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe800/0x575506951eea0e14 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830595.648506:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe800/0x575506951eea0e14 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830595.648513:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe800/0x575506951eea0e14 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830595.648519:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e25820fe800 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:1.0:1788830595.648524:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe800/0x575506951eea0e14 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830595.648532:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe800/0x575506951eea0e14 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830595.648547:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e25518dc500) 00010000:00010000:1.0:1788830595.648550:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788830595.648555:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe800/0x575506951eea0e14 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830595.648561:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe800/0x575506951eea0e14 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788830595.648575:0:5832:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b870d6ee reply state 000000001f38d9a5 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea0e1b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788830595.648584:0:5832:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788830595.648621:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff400/0x575506951eea0e0d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661cea expref: 13 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830595.648650:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea0e22 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661cea expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830595.648658:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e257480c700) 00010000:00010000:1.0:1788830595.648660:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788830595.648662:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e25820ff800, rc 0) 00000100:00100000:1.0:1788830595.649117:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255005ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+13:10279:x1875724578351744:12345-192.168.201.21@tcp:101:bash.0 Request processed in 1916us (2431us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1788830595.649126:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 40 00010000:00010000:1.0:1788830595.654357:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea0e1b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830595.654375:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea0e1b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830595.654382:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea0e1b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830595.654388:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e25820fe400 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:1.0:1788830595.654393:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea0e1b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830595.654401:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea0e1b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830595.654421:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9e257480c000) 00010000:00010000:1.0:1788830595.654424:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788830595.654429:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea0e1b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830595.654450:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea0e1b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788830595.655782:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830595.656391:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578351872 00000100:00100000:1.0:1788830595.656403:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578351872 00000100:00100000:1.0:1788830595.656455:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 22 00000100:00100000:1.0:1788830595.656464:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e244599b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2351:x1875724578351872:12345-192.168.201.21@tcp:8:bash.0 00010000:00080000:1.0:1788830595.656499:0:6679:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 1ef2fe7a-e5ec-4085-8326-b72aa00876cd@192.168.201.21@tcp t0 exp 0000000000000000 cur 349 last 0 00000020:00000080:1.0:1788830595.656533:0:6679:0:(genops.c:1385:class_connect()) connect: client 1ef2fe7a-e5ec-4085-8326-b72aa00876cd, cookie 0x575506951eea0e30 00002000:00100000:1.0:1788830595.656545:0:6679:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 1ef2fe7a-e5ec-4085-8326-b72aa00876cd/ffff9e2544c04000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113968 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788830595.656570:0:6679:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788830595.656833:0:6679:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788830595.656864:0:6679:0:(import.c:65:import_set_state_nolock()) ffff9e2544c04800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788830595.656941:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e244599b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+6:2351:x1875724578351872:12345-192.168.201.21@tcp:8:bash.0 Request processed in 476us (1166us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830595.656948:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 22 00000100:00100000:2.0:1788830595.660756:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830595.660863:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578352000 00000100:00100000:0.0:1788830595.660874:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578352000 00000100:00100000:0.0:1788830595.660950:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 23 00000100:00100000:0.0:1788830595.660961:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e244599a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+6:0:x1875724578352000:12345-192.168.201.21@tcp:101:bash.0 00010000:00010000:0.0:1788830595.660980:0:6677:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788830595.661016:0:6677:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f1451b0c/0x575506951eea0e37 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa578910534661cf1 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788830595.661051:0:6677:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788830595.661071:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=349s v=(0 0) 00010000:00010000:0.0:1788830595.661075:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788830595.661085:0:6677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f1451b0c/0x575506951eea0e37 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661cf1 expref: 7 pid: 6677 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830595.661118:0:6677:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f1451b0c/0x575506951eea0e37 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661cf1 expref: 7 pid: 6677 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830595.661133:0:6677:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2445b7e400, rc 0) 00000100:00100000:0.0:1788830595.661202:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e244599a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+7:0:x1875724578352000:12345-192.168.201.21@tcp:101:bash.0 Request processed in 243us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830595.661210:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 23 00000100:00080000:1.0:1788830595.661620:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788830595.665678:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830595.665840:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578352128 00000100:00100000:2.0:1788830595.665850:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578352128 00000100:00100000:2.0:1788830595.665898:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 24 00000100:00100000:2.0:1788830595.665908:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257f726300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+7:10279:x1875724578352128:12345-192.168.201.21@tcp:101:bash.0 00010000:00010000:2.0:1788830595.665928:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788830595.665947:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008f236222/0x575506951eea0e3e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa578910534661cf8 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830595.665980:0:6680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f1451b0c/0x575506951eea0e37 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661cf1 expref: 8 pid: 6677 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830595.666001:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788830595.666005:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788830595.666011:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008f236222/0x575506951eea0e3e lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661cf8 expref: 8 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830595.666044:0:6680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f1451b0c/0x575506951eea0e37 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.21@tcp remote: 0xa578910534661cf1 expref: 8 pid: 6677 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830595.666068:0:6680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f1451b0c/0x575506951eea0e37 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661cf1 expref: 8 pid: 6677 timeout: 449 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788830595.666083:0:6680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2445998e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6680:1875724595162880:192.168.201.21@tcp:104: 00000100:00100000:2.0:1788830595.666202:0:6680:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2565619b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788830595.669523:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830595.669629:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578352256 00000100:00100000:0.0:1788830595.669638:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578352256 00010000:00010000:0.0:1788830595.669695:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f1451b0c/0x575506951eea0e37 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661cf1 expref: 9 pid: 6677 timeout: 449 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788830595.669764:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 35 00000100:00100000:0.0:1788830595.669775:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257f724000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+9:2354:x1875724578352256:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788830595.669792:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788830595.669815:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f1451b0c/0x575506951eea0e37 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661cf1 expref: 9 pid: 6677 timeout: 449 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830595.669828:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f1451b0c/0x575506951eea0e37 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661cf1 expref: 9 pid: 6677 timeout: 449 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830595.669853:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788830595.669857:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788830595.669866:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008f236222/0x575506951eea0e3e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661cf8 expref: 9 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830595.669876:0:5819:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008f236222/0x575506951eea0e3e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661cf8 expref: 9 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830595.669914:0:5819:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000008f236222/0x575506951eea0e3e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661cf8 expref: 9 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788830595.669927:0:5819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25747c3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5819:1875724595163008:192.168.201.21@tcp:105: 00000100:00100000:0.0:1788830595.670015:0:5819:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e257fbd7e40 going to sleep for 11 seconds 00010000:00010000:2.0:1788830595.671191:0:6680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f1451b0c/0x575506951eea0e37 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661cf1 expref: 9 pid: 6677 timeout: 449 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788830595.671212:0:6680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2445998e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6680:1875724595162880:192.168.201.21@tcp:104: 00010000:00010000:2.0:1788830595.671240:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008f236222/0x575506951eea0e3e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.21@tcp remote: 0xa578910534661cf8 expref: 8 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830595.671252:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2565728c00, rc 0) 00000100:00100000:2.0:1788830595.671323:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257f726300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+8:10279:x1875724578352128:12345-192.168.201.21@tcp:101:bash.0 Request processed in 5415us (5656us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830595.671331:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 24 00000100:00100000:0.0:1788830595.678373:0:5819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25747c3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5819:1875724595163008:192.168.201.21@tcp:105: 00010000:00010000:0.0:1788830595.678417:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788830595.678480:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257f724000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+7:2354:x1875724578352256:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 8706us (8964us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830595.678491:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 35 00000100:00100000:1.0:1788830595.680183:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830595.680279:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578352512 00000100:00100000:2.0:1788830595.680288:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578352512 00000100:00100000:2.0:1788830595.680346:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 6 00000100:00100000:2.0:1788830595.680357:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2566013100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+12:10279:x1875724578352512:12345-192.168.201.21@tcp:35:bash.0 00000100:00100000:2.0:1788830595.680747:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2566013100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+13:10279:x1875724578352512:12345-192.168.201.21@tcp:35:bash.0 Request processed in 355us (534us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1788830595.680754:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 6 00000100:00100000:3.0:1788830595.794961:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830595.795168:0:8202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578352768 00000100:00100000:0.0:1788830595.795179:0:8202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578352768 00000100:00100000:0.0:1788830595.795252:0:8202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 41 00000100:00100000:0.0:1788830595.795263:0:8202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257f727100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+13:10289:x1875724578352768:12345-192.168.201.21@tcp:101:lfs.0 00010000:00010000:0.0:1788830595.795287:0:8202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788830595.795309:0:8202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea0e45 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa578910534661cff expref: -99 pid: 8202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788830595.795530:0:8202:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1788830595.795654:0:8202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea0e45 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661cff expref: 15 pid: 8202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830595.795669:0:8202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e25530b0200) 00010000:00010000:0.0:1788830595.795672:0:8202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788830595.795677:0:8202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea0e45 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661cff expref: 15 pid: 8202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830595.795691:0:8202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2445b7f800, rc 0) 00000100:00100000:1.0:1788830595.797664:0:8202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257f727100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+14:10289:x1875724578352768:12345-192.168.201.21@tcp:101:lfs.0 Request processed in 2392us (2702us total) trans 4294967313 rc 301/301 00000100:00100000:1.0:1788830595.797677:0:8202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 41 00000100:00100000:3.0:1788830595.801778:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830595.801860:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578353024 00000100:00100000:2.0:1788830595.801871:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578353024 00000100:00100000:2.0:1788830595.801968:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 7 00000100:00100000:2.0:1788830595.801980:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2545cbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+14:10289:x1875724578353024:12345-192.168.201.21@tcp:35:lfs.0 00000100:00100000:2.0:1788830595.802244:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2545cbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+15:10289:x1875724578353024:12345-192.168.201.21@tcp:35:lfs.0 Request processed in 266us (477us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1788830595.802253:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 7 00000100:00100000:2.0:1788830595.906006:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830595.906204:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578353152 00000100:00100000:0.0:1788830595.906214:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578353152 00000100:00100000:0.0:1788830595.906283:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 42 00000100:00100000:0.0:1788830595.906304:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2445998e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+15:10295:x1875724578353152:12345-192.168.201.21@tcp:101:lfs.0 00010000:00010000:0.0:1788830595.906329:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788830595.906363:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea0e53 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa578910534661d06 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830595.906445:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f000/0x575506951eea0e5a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830595.906460:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f000/0x575506951eea0e5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830595.906471:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f000/0x575506951eea0e5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788830595.906506:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1788830595.906509:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788830595.906526:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f000/0x575506951eea0e5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830595.906553:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea0e53 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661d06 expref: 17 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830595.906569:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f000/0x575506951eea0e5a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661d06 expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830595.906578:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e25518dc500) 00010000:00010000:0.0:1788830595.906581:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788830595.906584:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2445b7f000, rc 0) 00000100:00100000:0.0:1788830595.906697:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2445998e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+16:10295:x1875724578353152:12345-192.168.201.21@tcp:101:lfs.0 Request processed in 404us (712us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830595.906704:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 42 00000100:00100000:3.0:1788830595.915463:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830595.915743:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578353408 00000100:00100000:0.0:1788830595.915767:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578353408 00000100:00100000:0.0:1788830595.915852:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 43 00000100:00100000:0.0:1788830595.915863:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2545cbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+16:10295:x1875724578353408:12345-192.168.201.21@tcp:101:lfs.0 00010000:00010000:0.0:1788830595.915884:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788830595.915906:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea0e61 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa578910534661d0d expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830595.916027:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e400/0x575506951eea0e68 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830595.916041:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e400/0x575506951eea0e68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830595.916052:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e400/0x575506951eea0e68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788830595.916063:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788830595.916210:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea0e61 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661d0d expref: 19 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830595.916229:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e400/0x575506951eea0e68 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661d0d expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830595.916238:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e257480c700) 00010000:00010000:0.0:1788830595.916241:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788830595.916244:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2445b7e400, rc 0) 00000100:00100000:0.0:1788830595.916316:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2545cbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+18:10295:x1875724578353408:12345-192.168.201.21@tcp:101:lfs.0 Request processed in 456us (864us total) trans 4294967315 rc 0/0 00000100:00100000:0.0:1788830595.916323:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 43 00000100:00100000:3.0:1788830595.921658:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830595.922019:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578353664 00000100:00100000:0.0:1788830595.922030:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578353664 00000100:00100000:0.0:1788830595.922095:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 44 00000100:00100000:0.0:1788830595.922118:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25654d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+18:10295:x1875724578353664:12345-192.168.201.21@tcp:101:lfs.0 00010000:00010000:0.0:1788830595.922141:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788830595.922162:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea0e76 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa578910534661d14 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830595.922257:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e200/0x575506951eea0e7d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830595.922271:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e200/0x575506951eea0e7d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830595.922283:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e200/0x575506951eea0e7d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788830595.922307:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788830595.922675:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea0e76 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661d14 expref: 21 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830595.922694:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e200/0x575506951eea0e7d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661d14 expref: 20 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830595.922703:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e257480c700) 00010000:00010000:0.0:1788830595.922706:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788830595.922748:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2445b7e200, rc 0) 00000100:00100000:0.0:1788830595.922834:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25654d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+20:10295:x1875724578353664:12345-192.168.201.21@tcp:101:lfs.0 Request processed in 729us (1185us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1788830595.922854:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 44 00000100:00100000:2.0:1788830595.932993:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830595.933082:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578353792 00000100:00100000:1.0:1788830595.933092:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578353792 00000100:00100000:1.0:1788830595.933169:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 2 00000100:00100000:1.0:1788830595.933181:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2551309f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+20:2352:x1875724578353792:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788830595.933216:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788830595.933242:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e400/0x575506951eea0e68 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661d0d expref: 20 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830595.933263:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e257480c700) 00010000:00010000:1.0:1788830595.933267:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788830595.933341:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2551309f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+19:2352:x1875724578353792:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 161us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830595.933348:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 2 00000100:00100000:3.0:1788830595.940100:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830595.940751:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578353920 00000100:00100000:2.0:1788830595.940761:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578353920 00000100:00100000:2.0:1788830595.940823:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 25 00000100:00100000:2.0:1788830595.940833:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25654d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+7:2354:x1875724578353920:12345-192.168.201.21@tcp:1:lfs.0 00010000:00010000:2.0:1788830595.940878:0:6679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009f4303fc/0x575506951eea0e8b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830595.940900:0:6679:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008f236222/0x575506951eea0e3e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.21@tcp remote: 0xa578910534661cf8 expref: 7 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830595.940909:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788830595.940913:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788830595.940917:0:6679:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009f4303fc/0x575506951eea0e8b lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830595.940955:0:6679:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008f236222/0x575506951eea0e3e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.21@tcp remote: 0xa578910534661cf8 expref: 7 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830595.941002:0:6679:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008f236222/0x575506951eea0e3e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.21@tcp remote: 0xa578910534661cf8 expref: 7 pid: 6680 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788830595.941018:0:6679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e255130ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6679:1875724595163136:192.168.201.21@tcp:104: 00000100:00100000:2.0:1788830595.941131:0:6679:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e25656190c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788830595.953062:0:6679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e255130ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6679:1875724595163136:192.168.201.21@tcp:104: 00010000:00010000:1.0:1788830595.953095:0:6679:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009f4303fc/0x575506951eea0e8b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788830595.958859:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830595.959119:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578354048 00000100:00100000:0.0:1788830595.959130:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578354048 00002000:00100000:0.0:1788830595.959180:0:6683:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff9e25654d3480 x1875724578354048/t0(0) o4->1ef2fe7a-e5ec-4085-8326-b72aa00876cd@192.168.201.21@tcp:46/0 lens 504/0 e 0 to 0 dl 1788830606 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788830595.959191:0:6683:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e25654d3480 with x1875724578354048 ext(0->12) 00010000:00010000:0.0:1788830595.959200:0:6683:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000008f236222/0x575506951eea0e3e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.21@tcp remote: 0xa578910534661cf8 expref: 8 pid: 6680 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830595.959217:0:6683:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000008f236222/0x575506951eea0e3e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.21@tcp remote: 0xa578910534661cf8 expref: 8 pid: 6680 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788830595.959226:0:6683:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9e25654d3480 00000100:00100000:0.0:1788830595.959264:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 0 00000100:00100000:0.0:1788830595.959275:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25654d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+8:2355:x1875724578354048:12345-192.168.201.21@tcp:4:lfs.0 00000001:00100000:3.0:1788830596.025685:0:7646:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 1ef2fe7a-e5ec-4085-8326-b72aa00876cd 00000001:00080000:1.0:1788830596.056420:0:7646:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000100:00100000:0.0:1788830596.056690:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25654d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+7:2355:x1875724578354048:12345-192.168.201.21@tcp:4:lfs.0 Request processed in 97410us (97834us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1788830596.056703:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 0 00002000:00100000:0.0:1788830596.056748:0:6683:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff9e25654d3480 x1875724578354048/t4294967299(0) o4->1ef2fe7a-e5ec-4085-8326-b72aa00876cd@192.168.201.21@tcp:46/0 lens 504/448 e 0 to 0 dl 1788830606 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788830596.056759:0:6683:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e25654d3480 with x1875724578354048 ext(0->12) 00010000:00010000:0.0:1788830596.056771:0:6683:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000008f236222/0x575506951eea0e3e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.21@tcp remote: 0xa578910534661cf8 expref: 7 pid: 6680 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830596.056807:0:6683:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000008f236222/0x575506951eea0e3e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.21@tcp remote: 0xa578910534661cf8 expref: 7 pid: 6680 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788830596.056817:0:6683:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9e25654d3480 00000100:00100000:2.0:1788830596.061400:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830596.061505:0:11161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578354176 00000100:00100000:1.0:1788830596.061516:0:11161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578354176 00010000:00010000:1.0:1788830596.061556:0:11161:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008f236222/0x575506951eea0e3e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.21@tcp remote: 0xa578910534661cf8 expref: 7 pid: 6680 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788830596.061660:0:11161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 36 00000100:00100000:1.0:1788830596.061671:0:11161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255130ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+7:2352:x1875724578354176:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788830596.061687:0:11161:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1788830596.061706:0:11161:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1788830596.061739:0:11161:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1788830595 00002000:00010000:1.0:1788830596.061743:0:11161:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb atime from disk: 0 -> 1788830595 00002000:00010000:1.0:1788830596.061745:0:11161:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1788830595 00002000:00010000:1.0:1788830596.061760:0:11161:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:1.0:1788830596.061768:0:11161:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008f236222/0x575506951eea0e3e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.21@tcp remote: 0xa578910534661cf8 expref: 7 pid: 6680 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830596.061782:0:11161:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008f236222/0x575506951eea0e3e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.21@tcp remote: 0xa578910534661cf8 expref: 7 pid: 6680 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830596.061807:0:11161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008f236222/0x575506951eea0e3e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.21@tcp remote: 0xa578910534661cf8 expref: 7 pid: 6680 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830596.061825:0:11161:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788830596.061830:0:11161:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788830596.061835:0:11161:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009f4303fc/0x575506951eea0e8b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830596.061847:0:11161:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009f4303fc/0x575506951eea0e8b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830596.061871:0:11161:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788830596.061931:0:11161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255130ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+6:2352:x1875724578354176:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 261us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830596.061937:0:11161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 36 00010000:00010000:2.0:1788830596.062002:0:6679:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009f4303fc/0x575506951eea0e8b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830596.062012:0:6679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009f4303fc/0x575506951eea0e8b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830596.062037:0:6679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009f4303fc/0x575506951eea0e8b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830596.062045:0:6679:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009f4303fc/0x575506951eea0e8b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830596.062053:0:6679:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009f4303fc/0x575506951eea0e8b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830596.062061:0:6679:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2565729000 already unused, calling callback (ffffffffc14cb350) 00010000:00010000:2.0:1788830596.062065:0:6679:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009f4303fc/0x575506951eea0e8b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830596.062086:0:6679:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009f4303fc/0x575506951eea0e8b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830596.062114:0:6679:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009f4303fc/0x575506951eea0e8b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830596.062122:0:6679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009f4303fc/0x575506951eea0e8b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788830596.062170:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25654d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+5:2354:x1875724578353920:12345-192.168.201.21@tcp:1:lfs.0 Request processed in 121338us (122081us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830596.062178:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 25 00000100:00100000:2.0:1788830596.065355:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830596.065917:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578354432 00000100:00100000:3.0:1788830596.065928:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578354432 00000100:00100000:3.0:1788830596.065998:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 8 00000100:00100000:3.0:1788830596.066011:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2565499880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+19:10295:x1875724578354432:12345-192.168.201.21@tcp:35:lfs.0 00000004:00010000:3.0:1788830596.066082:0:5835:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e200/0x575506951eea0e7d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661d14 expref: 19 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788830596.066397:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:3.0:1788830596.066459:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:3.0:1788830596.067030:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:3.0:1788830596.067091:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d80e800/0x575506951eea0e92 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830596.067120:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea0e22 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661cea expref: 23 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830596.067130:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d80e800/0x575506951eea0e92 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830596.067165:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea0e22 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.21@tcp remote: 0xa578910534661cea expref: 23 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830596.067180:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea0e22 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661cea expref: 23 pid: 5832 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788830596.067206:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25654d0a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5835:1875724595163264:192.168.201.21@tcp:104: 00000100:00100000:3.0:1788830596.067297:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e255385df00 going to sleep for 11 seconds 00000100:00100000:3.0:1788830596.070265:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830596.070494:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25654d0a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5835:1875724595163264:192.168.201.21@tcp:104: 00010000:00010000:1.0:1788830596.070525:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d80e800/0x575506951eea0e92 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788830596.070593:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578354560 00000100:00100000:2.0:1788830596.070601:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578354560 00010000:00010000:2.0:1788830596.070642:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea0e22 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661cea expref: 24 pid: 5832 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788830596.070838:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 37 00000100:00100000:2.0:1788830596.070850:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25654d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+24:2355:x1875724578354560:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788830596.070867:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788830596.070876:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea0e22 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661cea expref: 24 pid: 5832 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830596.070887:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea0e22 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661cea expref: 24 pid: 5832 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830596.070923:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea0e22 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661cea expref: 24 pid: 5832 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830596.070938:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e257480c700) 00010000:00010000:2.0:1788830596.070943:0:5817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d80e800/0x575506951eea0e92 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830596.070951:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d80e800/0x575506951eea0e92 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830596.070958:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d80e800/0x575506951eea0e92 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830596.070993:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788830596.071058:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25654d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+23:2355:x1875724578354560:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 210us (802us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830596.071066:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 37 00010000:00010000:1.0:1788830596.071512:0:5835:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d80e800/0x575506951eea0e92 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830596.071527:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d80e800/0x575506951eea0e92 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788830596.071648:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:1.0:1788830596.071880:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:1.0:1788830596.071989:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2565cc0700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5835:1875724595163392:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788830596.072067:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830596.072092:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2548034480 going to sleep for 11 seconds 00000100:00100000:3.0:1788830596.072349:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595163392 00000100:00100000:3.0:1788830596.072358:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595163392 00000100:00100000:3.0:1788830596.072419:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788830596.072428:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2565cc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5835:x1875724595163392:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788830596.072503:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2565cc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5835:x1875724595163392:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 77us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830596.072511:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1788830596.072963:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788830596.073008:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2565cc0700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5835:1875724595163392:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1788830596.073965:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:1.0:1788830596.074187:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2565cc0700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5835:1875724595163520:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788830596.074237:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830596.074312:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e25480349c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788830596.074511:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595163520 00000100:00100000:3.0:1788830596.074518:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595163520 00000100:00100000:3.0:1788830596.074559:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788830596.074567:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2565cc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5835:x1875724595163520:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788830596.075247:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2565cc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5835:x1875724595163520:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 678us (1006us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1788830596.075260:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788830596.075282:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2565cc0700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5835:1875724595163520:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1788830596.075425:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:1.0:1788830596.075469:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d80e800/0x575506951eea0e92 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830596.075480:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d80e800/0x575506951eea0e92 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830596.075488:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d80e800/0x575506951eea0e92 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830596.075494:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e257d80e800 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:1.0:1788830596.075499:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d80e800/0x575506951eea0e92 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830596.075517:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d80e800/0x575506951eea0e92 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830596.075534:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e257480c700) 00010000:00010000:1.0:1788830596.075537:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1788830596.075541:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d80e800/0x575506951eea0e92 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830596.075547:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d80e800/0x575506951eea0e92 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788830596.075940:0:5835:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1788830596.076248:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:1.0:1788830596.076257:0:5835:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 349423547583ns, next at 350423545803ns, rc = 0 00000001:00080000:1.0:1788830596.076263:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:1.0:1788830596.076289:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e257480c700) 00010000:00010000:1.0:1788830596.076292:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788830596.076299:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e200/0x575506951eea0e7d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661d14 expref: 27 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788830596.076407:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2565499880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+26:10295:x1875724578354432:12345-192.168.201.21@tcp:35:lfs.0 Request processed in 10399us (11061us total) trans 4294967325 rc 0/0 00000100:00100000:1.0:1788830596.076416:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 8 00000020:00080000:1.0:1788830596.076421:0:5835:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1788830596.081438:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830596.081595:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578354688 00000100:00100000:0.0:1788830596.081607:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578354688 00000100:00100000:0.0:1788830596.081677:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 45 00000100:00100000:0.0:1788830596.081687:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25654d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+26:10295:x1875724578354688:12345-192.168.201.21@tcp:101:lfs.0 00010000:00010000:0.0:1788830596.081740:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788830596.081766:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea0e99 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa578910534661d1b expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830596.081845:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea0e99 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661d1b expref: 27 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830596.081861:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea0e99 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661d1b expref: 27 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830596.081880:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e25518dc600) 00010000:00010000:0.0:1788830596.081884:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788830596.081888:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2445b7f800, rc 0) 00000100:00100000:0.0:1788830596.081939:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25654d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+27:10295:x1875724578354688:12345-192.168.201.21@tcp:101:lfs.0 Request processed in 255us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830596.081944:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 45 00000100:00100000:2.0:1788830596.085554:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830596.085653:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578354944 00000100:00100000:0.0:1788830596.085679:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578354944 00000100:00100000:0.0:1788830596.085766:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 9 00000100:00100000:0.0:1788830596.085777:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25629b2050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+27:10295:x1875724578354944:12345-192.168.201.21@tcp:35:lfs.0 00000100:00100000:0.0:1788830596.086096:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25629b2050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+28:10295:x1875724578354944:12345-192.168.201.21@tcp:35:lfs.0 Request processed in 320us (549us total) trans 4294967326 rc 0/0 00000100:00100000:0.0:1788830596.086117:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 9 00010000:00010000:0.0:1788830596.123963:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788830596.193991:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830596.194081:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578355200 00000100:00100000:1.0:1788830596.194113:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578355200 00000100:00100000:1.0:1788830596.194260:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 46 00000100:00100000:1.0:1788830596.194272:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2565499180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+28:10306:x1875724578355200:12345-192.168.201.21@tcp:101:lfs.0 00010000:00010000:1.0:1788830596.194316:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788830596.194338:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff400/0x575506951eea0ea0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa578910534661d22 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788830596.194537:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:1.0:1788830596.194670:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff400/0x575506951eea0ea0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661d22 expref: 30 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830596.194686:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e25530b0200) 00010000:00010000:1.0:1788830596.194689:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788830596.194694:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff400/0x575506951eea0ea0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661d22 expref: 30 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830596.194885:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e25820ff400, rc 0) 00000100:00100000:1.0:1788830596.194957:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2565499180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+29:10306:x1875724578355200:12345-192.168.201.21@tcp:101:lfs.0 Request processed in 687us (988us total) trans 4294967327 rc 301/301 00000100:00100000:1.0:1788830596.194964:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 46 00000100:00100000:2.0:1788830596.202105:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830596.202170:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578355328 00000100:00100000:0.0:1788830596.202186:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578355328 00000100:00100000:0.0:1788830596.202254:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 47 00000100:00100000:0.0:1788830596.202264:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e256549b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+29:10306:x1875724578355328:12345-192.168.201.21@tcp:34:lfs.0 00010000:00010000:0.0:1788830596.202338:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea0eae lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830596.202354:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea0eae lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830596.202366:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea0eae lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830596.202382:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ec00/0x575506951eea0eb5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830596.202389:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ec00/0x575506951eea0eb5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830596.202396:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ec00/0x575506951eea0eb5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830596.202478:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e200/0x575506951eea0ebc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830596.202499:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e200/0x575506951eea0ebc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830596.202506:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e200/0x575506951eea0ebc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788830596.202545:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e200/0x575506951eea0ebc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830596.202557:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea0eae lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830596.202564:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea0eae lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830596.202571:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea0eae lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830596.202577:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2445b7ee00 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:0.0:1788830596.202581:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea0eae lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830596.202588:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea0eae lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830596.202598:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e25518dc500) 00010000:00010000:0.0:1788830596.202602:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788830596.202606:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea0eae lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830596.202612:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea0eae lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830596.202629:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ec00/0x575506951eea0eb5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830596.202635:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ec00/0x575506951eea0eb5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830596.202641:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ec00/0x575506951eea0eb5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830596.202646:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2445b7ec00 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:0.0:1788830596.202648:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ec00/0x575506951eea0eb5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830596.202654:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ec00/0x575506951eea0eb5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830596.202662:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9e25518dc200) 00010000:00010000:0.0:1788830596.202665:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788830596.202668:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ec00/0x575506951eea0eb5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830596.202674:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ec00/0x575506951eea0eb5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830596.202689:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e200/0x575506951eea0ebc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830596.202695:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e200/0x575506951eea0ebc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830596.202702:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e200/0x575506951eea0ebc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830596.202742:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2445b7e200 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:0.0:1788830596.202745:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e200/0x575506951eea0ebc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830596.202752:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e200/0x575506951eea0ebc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830596.202761:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e25518dc600) 00010000:00010000:0.0:1788830596.202763:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788830596.202766:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e200/0x575506951eea0ebc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830596.202773:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e200/0x575506951eea0ebc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788830596.202850:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e256549b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+29:10306:x1875724578355328:12345-192.168.201.21@tcp:34:lfs.0 Request processed in 586us (769us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830596.202858:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 47 00000100:00100000:2.0:1788830596.208871:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830596.209033:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578355584 00000100:00100000:3.0:1788830596.209048:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578355584 00000100:00100000:3.0:1788830596.209139:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 10 00000100:00100000:3.0:1788830596.209152:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2565498380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+29:10306:x1875724578355584:12345-192.168.201.21@tcp:35:lfs.0 00000100:00100000:3.0:1788830596.209651:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2565498380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+30:10306:x1875724578355584:12345-192.168.201.21@tcp:35:lfs.0 Request processed in 500us (795us total) trans 4294967328 rc 0/0 00000100:00100000:3.0:1788830596.209660:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 10 00000100:00100000:2.0:1788830596.277445:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830596.277611:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578355840 00000100:00100000:0.0:1788830596.277625:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578355840 00000100:00100000:0.0:1788830596.277697:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 48 00000100:00100000:0.0:1788830596.277735:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e256549a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+30:10309:x1875724578355840:12345-192.168.201.21@tcp:101:lfs.0 00010000:00010000:0.0:1788830596.277761:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788830596.277782:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e200/0x575506951eea0ec3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa578910534661d29 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830596.277859:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ec00/0x575506951eea0eca lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830596.277891:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ec00/0x575506951eea0eca lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830596.277903:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ec00/0x575506951eea0eca lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830596.277918:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea0ed1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830596.277925:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea0ed1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830596.277931:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea0ed1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830596.278156:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e400/0x575506951eea0ed8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830596.278166:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e400/0x575506951eea0ed8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830596.278174:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e400/0x575506951eea0ed8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788830596.278183:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788830596.278278:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ec00/0x575506951eea0eca lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830596.278286:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ec00/0x575506951eea0eca lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830596.278293:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ec00/0x575506951eea0eca lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830596.278307:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2445b7ec00 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:0.0:1788830596.278312:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ec00/0x575506951eea0eca lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830596.278320:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ec00/0x575506951eea0eca lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830596.278335:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e25518dc500) 00010000:00010000:0.0:1788830596.278338:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788830596.278342:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ec00/0x575506951eea0eca lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830596.278348:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ec00/0x575506951eea0eca lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830596.278360:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea0ed1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830596.278366:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea0ed1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830596.278371:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea0ed1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830596.278376:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2445b7ee00 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:0.0:1788830596.278378:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea0ed1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830596.278384:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea0ed1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830596.278403:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9e25518dc200) 00010000:00010000:0.0:1788830596.278405:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788830596.278408:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea0ed1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830596.278414:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea0ed1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830596.278457:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e200/0x575506951eea0ec3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661d29 expref: 33 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830596.278470:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e400/0x575506951eea0ed8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661d29 expref: 32 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830596.278477:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e25518dc600) 00010000:00010000:0.0:1788830596.278479:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788830596.278482:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2445b7e400, rc 0) 00000100:00100000:0.0:1788830596.278602:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e256549a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+32:10309:x1875724578355840:12345-192.168.201.21@tcp:101:lfs.0 Request processed in 895us (1167us total) trans 4294967329 rc 0/0 00000100:00100000:0.0:1788830596.278610:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 48 00000100:00100000:2.0:1788830596.285841:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830596.286001:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578355968 00000100:00100000:3.0:1788830596.286011:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578355968 00000100:00100000:3.0:1788830596.286081:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 49 00000100:00100000:3.0:1788830596.286092:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2565498000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+32:10309:x1875724578355968:12345-192.168.201.21@tcp:54:lfs.0 00010000:00010000:3.0:1788830596.286174:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d80fe00/0x575506951eea0ee6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830596.286191:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d80fe00/0x575506951eea0ee6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830596.286203:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d80fe00/0x575506951eea0ee6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830596.286227:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d80fe00/0x575506951eea0ee6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830596.286235:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d80fe00/0x575506951eea0ee6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830596.286242:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d80fe00/0x575506951eea0ee6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830596.286248:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e257d80fe00 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:3.0:1788830596.286253:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d80fe00/0x575506951eea0ee6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830596.286260:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d80fe00/0x575506951eea0ee6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830596.286271:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e25518dc600) 00010000:00010000:3.0:1788830596.286275:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788830596.286279:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d80fe00/0x575506951eea0ee6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830596.286296:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d80fe00/0x575506951eea0ee6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788830596.286378:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2565498000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+32:10309:x1875724578355968:12345-192.168.201.21@tcp:54:lfs.0 Request processed in 287us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830596.286386:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 49 00000100:00100000:2.0:1788830596.289161:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830596.290057:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578356224 00000100:00100000:0.0:1788830596.290068:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578356224 00000100:00100000:0.0:1788830596.290169:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 11 00000100:00100000:0.0:1788830596.290180:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e256549bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+32:10309:x1875724578356224:12345-192.168.201.21@tcp:35:lfs.0 00000100:00100000:0.0:1788830596.290414:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e256549bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+33:10309:x1875724578356224:12345-192.168.201.21@tcp:35:lfs.0 Request processed in 236us (1262us total) trans 4294967330 rc 0/0 00000100:00100000:0.0:1788830596.290421:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 11 00000100:00100000:2.0:1788830596.618984:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830596.619100:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578356480 00000100:00100000:0.0:1788830596.619112:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578356480 00000100:00100000:0.0:1788830596.619180:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 50 00000100:00100000:0.0:1788830596.619191:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2565499c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+33:10340:x1875724578356480:12345-192.168.201.21@tcp:101:cat.0 00010000:00010000:0.0:1788830596.619216:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788830596.619240:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e200/0x575506951eea0eed lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa578910534661d30 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830596.619358:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea0ef4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830596.619375:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea0ef4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830596.619388:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea0ef4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788830596.619400:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788830596.619564:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e200/0x575506951eea0eed lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661d30 expref: 36 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830596.619585:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea0ef4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661d30 expref: 35 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830596.619593:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e25518dc600) 00010000:00010000:0.0:1788830596.619596:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788830596.619599:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2445b7ee00, rc 0) 00000100:00100000:0.0:1788830596.619672:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2565499c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+35:10340:x1875724578356480:12345-192.168.201.21@tcp:101:cat.0 Request processed in 482us (703us total) trans 4294967331 rc 0/0 00000100:00100000:0.0:1788830596.619697:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 50 00000100:00100000:2.0:1788830596.646253:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830596.646310:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830596.646414:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578356608 00000100:00100000:0.0:1788830596.646425:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578356608 00000100:00100000:0.0:1788830596.646493:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 3 00000100:00100000:0.0:1788830596.646503:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2547434450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+35:2355:x1875724578356608:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788830596.646519:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788830596.646546:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea0ef4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661d30 expref: 35 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830596.646566:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e25518dc600) 00010000:00010000:0.0:1788830596.646570:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788830596.646630:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2547434450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+34:2355:x1875724578356608:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 129us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830596.646638:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 3 00000100:00100000:3.0:1788830596.647329:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578356864 00000100:00100000:3.0:1788830596.647345:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578356864 00000100:00100000:3.0:1788830596.647453:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 12 00000100:00100000:3.0:1788830596.647463:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2565499500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+34:10340:x1875724578356864:12345-192.168.201.21@tcp:35:cat.0 00000100:00100000:3.0:1788830596.647699:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2565499500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+35:10340:x1875724578356864:12345-192.168.201.21@tcp:35:cat.0 Request processed in 236us (1388us total) trans 4294967332 rc 0/0 00000100:00100000:3.0:1788830596.647706:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 12 00000100:00100000:2.0:1788830596.733938:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830596.734160:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578357120 00000100:00100000:3.0:1788830596.734181:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578357120 00000100:00100000:3.0:1788830596.734283:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 51 00000100:00100000:3.0:1788830596.734297:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e256549a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+35:10346:x1875724578357120:12345-192.168.201.21@tcp:101:dd.0 00010000:00010000:3.0:1788830596.734330:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788830596.734334:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788830596.734372:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f000/0x575506951eea0e5a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661d06 expref: 35 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830596.734397:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e25518dc500) 00010000:00010000:3.0:1788830596.734402:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788830596.734421:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d80fe00/0x575506951eea0f02 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa578910534661d37 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830596.734584:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d80e800/0x575506951eea0f09 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830596.734601:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e400/0x575506951eea0ed8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661d29 expref: 35 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830596.734611:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d80e800/0x575506951eea0f09 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830596.734655:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e400/0x575506951eea0ed8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.21@tcp remote: 0xa578910534661d29 expref: 35 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830596.734673:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e400/0x575506951eea0ed8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661d29 expref: 35 pid: 5834 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788830596.734690:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25654d3800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5833:1875724595163648:192.168.201.21@tcp:104: 00000100:00100000:3.0:1788830596.735129:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e255385d300 going to sleep for 11 seconds 00000100:00100000:3.0:1788830596.747696:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25654d3800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5833:1875724595163648:192.168.201.21@tcp:104: 00010000:00010000:3.0:1788830596.747800:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d80e800/0x575506951eea0f09 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788830596.749671:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830596.750160:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578357248 00000100:00100000:0.0:1788830596.750174:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578357248 00010000:00010000:0.0:1788830596.751150:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e400/0x575506951eea0ed8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661d29 expref: 36 pid: 5834 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788830596.752983:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 38 00000100:00100000:0.0:1788830596.753013:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2565498e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+36:2354:x1875724578357248:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788830596.753039:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788830596.753063:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e400/0x575506951eea0ed8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661d29 expref: 36 pid: 5834 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830596.753082:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e400/0x575506951eea0ed8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661d29 expref: 36 pid: 5834 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830596.753145:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e400/0x575506951eea0ed8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661d29 expref: 36 pid: 5834 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830596.753165:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e25518dc600) 00010000:00010000:0.0:1788830596.753171:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d80e800/0x575506951eea0f09 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830596.753182:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d80e800/0x575506951eea0f09 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830596.753190:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d80e800/0x575506951eea0f09 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830596.753229:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788830596.753553:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2565498e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+35:2354:x1875724578357248:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 554us (3892us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830596.753562:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 38 00010000:00010000:3.0:1788830596.753641:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d80e800/0x575506951eea0f09 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830596.753651:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d80e800/0x575506951eea0f09 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788830596.753675:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788830596.753946:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d80fe00/0x575506951eea0f02 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661d37 expref: 36 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830596.753970:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d80e800/0x575506951eea0f09 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661d37 expref: 35 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830596.753979:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e25518dc600) 00010000:00010000:3.0:1788830596.753982:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788830596.753985:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e257d80e800, rc 0) 00000100:00100000:3.0:1788830596.754022:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e256549a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+35:10346:x1875724578357120:12345-192.168.201.21@tcp:101:dd.0 Request processed in 19728us (20095us total) trans 4294967333 rc 0/0 00000100:00100000:3.0:1788830596.754030:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 51 00000100:00100000:2.0:1788830596.758630:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830596.759106:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578357504 00000100:00100000:1.0:1788830596.759119:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578357504 00000100:00100000:1.0:1788830596.759199:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 52 00000100:00100000:1.0:1788830596.759213:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2565499f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+35:10346:x1875724578357504:12345-192.168.201.21@tcp:36:dd.0 00010000:00010000:1.0:1788830596.759765:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea0f17 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830596.759905:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea0f17 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830596.759922:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea0f17 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788830596.760136:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:1.0:1788830596.760165:0:5834:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001d2f5021 reply state 0000000028970fb8 transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea0f17 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788830596.760175:0:5834:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788830596.764909:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2565499f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+38:10346:x1875724578357504:12345-192.168.201.21@tcp:36:dd.0 Request processed in 5679us (6273us total) trans 4294967335 rc 0/0 00000100:00100000:1.0:1788830596.764927:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 52 00000020:00080000:1.0:1788830596.764938:0:5834:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788830596.769178:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea0f17 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830596.769201:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea0f17 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830596.769210:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea0f17 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830596.769218:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e25820fe400 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:3.0:1788830596.769224:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea0f17 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830596.769233:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea0f17 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830596.769255:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e25518dc600) 00010000:00010000:3.0:1788830596.769259:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788830596.769297:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea0f17 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830596.769304:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea0f17 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788830596.829314:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e256549b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875724595163776:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788830596.829621:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830596.829799:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595163776 00000100:00100000:1.0:1788830596.829810:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595163776 00000100:00100000:1.0:1788830596.829902:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788830596.829914:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25747c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875724595163776:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788830596.829964:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1788830596.830817:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788830596.832448:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25747c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875724595163776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2524us (2816us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830596.832465:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788830596.832745:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e256549b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875724595163776:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788830597.001334:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830597.001764:0:8202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578357632 00000100:00100000:1.0:1788830597.001775:0:8202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578357632 00000100:00100000:1.0:1788830597.001956:0:8202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 53 00000100:00100000:1.0:1788830597.001966:0:8202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2565498a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+37:10360:x1875724578357632:12345-192.168.201.21@tcp:101:stat.0 00010000:00010000:1.0:1788830597.001997:0:8202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788830597.002025:0:8202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffe00/0x575506951eea0f1e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa578910534661d3e expref: -99 pid: 8202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788830597.002119:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788830597.002131:0:8202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffa00/0x575506951eea0f25 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830597.002169:0:8202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffa00/0x575506951eea0f25 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830597.002185:0:8202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffa00/0x575506951eea0f25 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830597.002201:0:8202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea0f2c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830597.002206:0:8202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea0f2c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830597.002210:0:8202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea0f2c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830597.002433:0:8202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff400/0x575506951eea0f33 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830597.002445:0:8202:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d80e800/0x575506951eea0f09 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661d37 expref: 38 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830597.002455:0:8202:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff400/0x575506951eea0f33 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830597.002496:0:8202:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d80e800/0x575506951eea0f09 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.21@tcp remote: 0xa578910534661d37 expref: 38 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830597.002509:0:8202:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d80e800/0x575506951eea0f09 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661d37 expref: 38 pid: 5833 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788830597.002533:0:8202:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2565cc1880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8202:1875724595163904:192.168.201.21@tcp:104: 00000100:00100000:1.0:1788830597.002672:0:8202:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2544e41480 going to sleep for 11 seconds 00000100:00100000:1.0:1788830597.005151:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830597.005278:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578357888 00000100:00100000:0.0:1788830597.005290:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578357888 00000100:00100000:0.0:1788830597.005363:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 13 00000100:00100000:0.0:1788830597.005375:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2565cc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+39:5590:x1875724578357888:12345-192.168.201.21@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788830597.005789:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2565cc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+40:5590:x1875724578357888:12345-192.168.201.21@tcp:35:ldlm_bl.0 Request processed in 415us (651us total) trans 4294967336 rc 0/0 00000100:00100000:0.0:1788830597.005819:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 13 00000100:00100000:3.0:1788830597.007680:0:8202:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2565cc1880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8202:1875724595163904:192.168.201.21@tcp:104: 00000100:00100000:2.0:1788830597.007751:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830597.007795:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578358016 00000100:00100000:0.0:1788830597.007803:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578358016 00010000:00010000:0.0:1788830597.007848:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d80e800/0x575506951eea0f09 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661d37 expref: 40 pid: 5833 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788830597.007934:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 39 00000100:00100000:0.0:1788830597.007943:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e256549aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+40:2355:x1875724578358016:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788830597.007957:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788830597.007964:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d80e800/0x575506951eea0f09 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661d37 expref: 40 pid: 5833 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830597.007978:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d80e800/0x575506951eea0f09 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661d37 expref: 40 pid: 5833 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830597.008018:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d80e800/0x575506951eea0f09 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661d37 expref: 40 pid: 5833 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830597.008036:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e25518dc600) 00010000:00010000:0.0:1788830597.008041:0:5819:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff400/0x575506951eea0f33 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830597.008049:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff400/0x575506951eea0f33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830597.008055:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff400/0x575506951eea0f33 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830597.008101:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788830597.008136:0:8202:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff400/0x575506951eea0f33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830597.008147:0:8202:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff400/0x575506951eea0f33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830597.008152:0:8202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff400/0x575506951eea0f33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788830597.008168:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e256549aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+39:2355:x1875724578358016:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 225us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830597.008176:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 39 00000004:00200000:3.0:1788830597.008211:0:8202:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1788830597.008216:0:8202:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788830597.008262:0:8202:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff400/0x575506951eea0f33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830597.008277:0:8202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff400/0x575506951eea0f33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830597.008288:0:8202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffa00/0x575506951eea0f25 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830597.008308:0:8202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffa00/0x575506951eea0f25 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830597.008316:0:8202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffa00/0x575506951eea0f25 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830597.008330:0:8202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e25820ffa00 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:3.0:1788830597.008336:0:8202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffa00/0x575506951eea0f25 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830597.008345:0:8202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffa00/0x575506951eea0f25 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830597.008356:0:8202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e25518dc500) 00010000:00010000:3.0:1788830597.008359:0:8202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788830597.008364:0:8202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffa00/0x575506951eea0f25 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830597.008371:0:8202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffa00/0x575506951eea0f25 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830597.008385:0:8202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea0f2c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830597.008392:0:8202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea0f2c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830597.008398:0:8202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea0f2c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830597.008403:0:8202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e25820fe400 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:3.0:1788830597.008406:0:8202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea0f2c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830597.008412:0:8202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea0f2c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830597.008432:0:8202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9e257480c700) 00010000:00010000:3.0:1788830597.008434:0:8202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788830597.008438:0:8202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea0f2c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830597.008444:0:8202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea0f2c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830597.008492:0:8202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffe00/0x575506951eea0f1e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661d3e expref: 39 pid: 8202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830597.008508:0:8202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff400/0x575506951eea0f33 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661d3e expref: 38 pid: 8202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830597.008515:0:8202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e25518dc600) 00010000:00010000:3.0:1788830597.008517:0:8202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788830597.008520:0:8202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e25820ff400, rc 0) 00000100:00100000:3.0:1788830597.008550:0:8202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2565498a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+38:10360:x1875724578357632:12345-192.168.201.21@tcp:101:stat.0 Request processed in 6585us (7233us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830597.008556:0:8202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 53 00000100:00100000:2.0:1788830597.091873:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830597.092042:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578358272 00000100:00100000:1.0:1788830597.092057:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578358272 00000100:00100000:1.0:1788830597.092146:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 54 00000100:00100000:1.0:1788830597.092158:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e256549ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+38:10366:x1875724578358272:12345-192.168.201.21@tcp:36:truncate.0 00010000:00010000:1.0:1788830597.092239:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788830597.092276:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff400/0x575506951eea0f33 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661d3e expref: 38 pid: 8202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830597.092299:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e25518dc600) 00010000:00010000:1.0:1788830597.092304:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788830597.092815:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea0f3a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830597.092835:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea0f3a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830597.092847:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea0f3a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788830597.092910:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:1.0:1788830597.092937:0:5834:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e9a8b9b8 reply state 00000000280d91fe transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea0f3a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788830597.092948:0:5834:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788830597.093133:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e256549ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+40:10366:x1875724578358272:12345-192.168.201.21@tcp:36:truncate.0 Request processed in 974us (1273us total) trans 4294967338 rc 0/0 00000100:00100000:1.0:1788830597.093142:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 54 00000020:00080000:1.0:1788830597.093149:0:5834:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788830597.098753:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea0f3a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830597.098780:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea0f3a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830597.098790:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea0f3a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830597.098797:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e25820ff800 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:1.0:1788830597.098804:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea0f3a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830597.098813:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea0f3a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830597.098835:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e25518dc600) 00010000:00010000:1.0:1788830597.098838:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788830597.098844:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea0f3a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830597.098851:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea0f3a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830597.148610:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788830597.232462:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830597.232582:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578358400 00000100:00100000:0.0:1788830597.232597:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578358400 00000100:00100000:0.0:1788830597.232681:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 55 00000100:00100000:0.0:1788830597.232696:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e256549b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+39:10380:x1875724578358400:12345-192.168.201.21@tcp:101:stat.0 00010000:00010000:0.0:1788830597.232782:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788830597.232817:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e400/0x575506951eea0f41 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa578910534661d45 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830597.232920:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea0f48 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830597.232942:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea0f48 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830597.232958:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea0f48 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830597.232978:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e200/0x575506951eea0f4f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830597.232985:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e200/0x575506951eea0f4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830597.232992:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e200/0x575506951eea0f4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830597.233145:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ec00/0x575506951eea0f56 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830597.233218:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ec00/0x575506951eea0f56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830597.233226:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ec00/0x575506951eea0f56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788830597.233271:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:0.0:1788830597.233276:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788830597.233306:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ec00/0x575506951eea0f56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830597.233320:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ec00/0x575506951eea0f56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830597.233330:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea0f48 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830597.233336:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea0f48 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830597.233344:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea0f48 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830597.233350:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2445b7ee00 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:0.0:1788830597.233356:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea0f48 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830597.233365:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea0f48 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830597.233385:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e25518dc500) 00010000:00010000:0.0:1788830597.233389:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788830597.233395:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea0f48 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830597.233402:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea0f48 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830597.233419:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e200/0x575506951eea0f4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830597.233426:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e200/0x575506951eea0f4f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830597.233431:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e200/0x575506951eea0f4f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830597.233437:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2445b7e200 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:0.0:1788830597.233440:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e200/0x575506951eea0f4f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830597.233446:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e200/0x575506951eea0f4f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830597.233454:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9e25518dc200) 00010000:00010000:0.0:1788830597.233456:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788830597.233459:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e200/0x575506951eea0f4f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830597.233464:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e200/0x575506951eea0f4f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830597.233517:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e400/0x575506951eea0f41 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661d45 expref: 41 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830597.233531:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ec00/0x575506951eea0f56 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661d45 expref: 40 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830597.233539:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e25518dc600) 00010000:00010000:0.0:1788830597.233541:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788830597.233544:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2445b7ec00, rc 0) 00000100:00100000:0.0:1788830597.233634:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e256549b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+40:10380:x1875724578358400:12345-192.168.201.21@tcp:101:stat.0 Request processed in 941us (1188us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830597.233644:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 55 00000100:00100000:2.0:1788830597.305334:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830597.305450:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578358656 00000100:00100000:1.0:1788830597.305464:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578358656 00000100:00100000:1.0:1788830597.305536:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 56 00000100:00100000:1.0:1788830597.305544:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2565498700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+40:10390:x1875724578358656:12345-192.168.201.21@tcp:101:lfs.0 00010000:00010000:1.0:1788830597.305587:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788830597.305613:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea0f5d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa578910534661d4c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788830597.305751:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:1.0:1788830597.305913:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea0f5d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661d4c expref: 42 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830597.305927:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e25530b0200) 00010000:00010000:1.0:1788830597.305930:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788830597.305934:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea0f5d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661d4c expref: 42 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830597.305947:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e25820ff800, rc 0) 00000100:00100000:1.0:1788830597.306026:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2565498700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+41:10390:x1875724578358656:12345-192.168.201.21@tcp:101:lfs.0 Request processed in 482us (711us total) trans 4294967339 rc 301/301 00000100:00100000:1.0:1788830597.306032:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 56 00000100:00100000:2.0:1788830597.309930:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830597.309996:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578358912 00000100:00100000:0.0:1788830597.310011:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578358912 00000100:00100000:0.0:1788830597.310099:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 14 00000100:00100000:0.0:1788830597.310111:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e256549b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+41:10390:x1875724578358912:12345-192.168.201.21@tcp:35:lfs.0 00000100:00100000:0.0:1788830597.310416:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e256549b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+42:10390:x1875724578358912:12345-192.168.201.21@tcp:35:lfs.0 Request processed in 307us (499us total) trans 4294967340 rc 0/0 00000100:00100000:0.0:1788830597.310425:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 14 00000100:00100000:2.0:1788830597.340524:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830597.340693:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578359168 00000100:00100000:0.0:1788830597.340705:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578359168 00000100:00100000:0.0:1788830597.340813:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 57 00000100:00100000:0.0:1788830597.340823:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2565499880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+42:10396:x1875724578359168:12345-192.168.201.21@tcp:101:bash.0 00010000:00010000:0.0:1788830597.340853:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788830597.340876:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e400/0x575506951eea0f6b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa578910534661d53 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830597.341009:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e200/0x575506951eea0f72 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830597.341023:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ec00/0x575506951eea0f56 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661d45 expref: 43 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830597.341030:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e200/0x575506951eea0f72 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830597.341069:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ec00/0x575506951eea0f56 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.21@tcp remote: 0xa578910534661d45 expref: 43 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830597.341093:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ec00/0x575506951eea0f56 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661d45 expref: 43 pid: 5833 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788830597.341107:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25747c0380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5833:1875724595164032:192.168.201.21@tcp:104: 00000100:00100000:0.0:1788830597.341208:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2541254f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788830597.343266:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830597.343342:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578359296 00000100:00100000:1.0:1788830597.343354:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578359296 00010000:00010000:1.0:1788830597.343407:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ec00/0x575506951eea0f56 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661d45 expref: 44 pid: 5833 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788830597.343452:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 40 00000100:00100000:1.0:1788830597.343465:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257ffdc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+44:2354:x1875724578359296:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788830597.343481:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788830597.343488:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ec00/0x575506951eea0f56 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661d45 expref: 44 pid: 5833 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830597.343516:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ec00/0x575506951eea0f56 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661d45 expref: 44 pid: 5833 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830597.343544:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e25518dc600) 00010000:00010000:1.0:1788830597.343551:0:5817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e200/0x575506951eea0f72 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830597.343562:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e200/0x575506951eea0f72 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830597.343570:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e200/0x575506951eea0f72 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830597.343592:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788830597.343700:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257ffdc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+44:2354:x1875724578359296:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 237us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830597.343742:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 40 00010000:00010000:0.0:1788830597.343746:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ec00/0x575506951eea0f56 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661d45 expref: 44 pid: 5833 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788830597.343766:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25747c0380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5833:1875724595164032:192.168.201.21@tcp:104: 00010000:00010000:0.0:1788830597.343887:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e200/0x575506951eea0f72 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830597.343897:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e200/0x575506951eea0f72 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830597.343913:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e200/0x575506951eea0f72 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788830597.343936:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:0.0:1788830597.344520:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e400/0x575506951eea0f6b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661d53 expref: 44 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830597.344536:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e200/0x575506951eea0f72 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661d53 expref: 43 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830597.344543:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e25518dc600) 00010000:00010000:0.0:1788830597.344545:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788830597.344547:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2445b7e200, rc 0) 00000100:00100000:0.0:1788830597.344799:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2565499880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+43:10396:x1875724578359168:12345-192.168.201.21@tcp:101:bash.0 Request processed in 3976us (4286us total) trans 4294967341 rc 0/0 00000100:00100000:0.0:1788830597.344807:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 57 00000100:00100000:2.0:1788830597.346144:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830597.346256:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578359552 00000100:00100000:1.0:1788830597.346265:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578359552 00000100:00100000:1.0:1788830597.346490:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 58 00000100:00100000:1.0:1788830597.346503:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257ffdd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+43:10396:x1875724578359552:12345-192.168.201.21@tcp:36:bash.0 00010000:00010000:1.0:1788830597.346823:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea0f80 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830597.346841:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea0f80 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830597.346851:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea0f80 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788830597.346930:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:1.0:1788830597.346950:0:5834:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000930c8797 reply state 000000003119fcb8 transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea0f80 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788830597.346961:0:5834:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788830597.347063:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257ffdd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+46:10396:x1875724578359552:12345-192.168.201.21@tcp:36:bash.0 Request processed in 557us (925us total) trans 4294967343 rc 0/0 00000100:00100000:1.0:1788830597.347071:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 58 00000020:00080000:1.0:1788830597.347089:0:5834:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788830597.348415:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea0f80 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830597.348429:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea0f80 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830597.348437:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea0f80 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830597.348453:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e25820ff800 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:3.0:1788830597.348459:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea0f80 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830597.348468:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea0f80 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830597.348487:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e25518dc600) 00010000:00010000:3.0:1788830597.348491:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788830597.348495:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea0f80 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830597.348501:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea0f80 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788830597.350471:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830597.350821:0:8202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578359680 00000100:00100000:3.0:1788830597.350833:0:8202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578359680 00000100:00100000:2.0:1788830597.351006:0:8202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 59 00000100:00100000:2.0:1788830597.351018:0:8202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257ffdd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+45:10396:x1875724578359680:12345-192.168.201.21@tcp:101:bash.0 00010000:00010000:2.0:1788830597.351045:0:8202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788830597.351067:0:8202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729600/0x575506951eea0f87 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa578910534661d5a expref: -99 pid: 8202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830597.351174:0:8202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729000/0x575506951eea0f8e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830597.351188:0:8202:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e200/0x575506951eea0f72 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661d53 expref: 46 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830597.351213:0:8202:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729000/0x575506951eea0f8e lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830597.351248:0:8202:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e200/0x575506951eea0f72 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.21@tcp remote: 0xa578910534661d53 expref: 46 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830597.351260:0:8202:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e200/0x575506951eea0f72 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661d53 expref: 46 pid: 5833 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788830597.351273:0:8202:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257ffdf100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8202:1875724595164160:192.168.201.21@tcp:104: 00000100:00100000:2.0:1788830597.351376:0:8202:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2565619900 going to sleep for 11 seconds 00000100:00100000:2.0:1788830597.353107:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830597.353107:0:8202:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257ffdf100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8202:1875724595164160:192.168.201.21@tcp:104: 00010000:00010000:1.0:1788830597.353139:0:8202:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729000/0x575506951eea0f8e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788830597.353463:0:11161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578359808 00000100:00100000:3.0:1788830597.353471:0:11161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578359808 00010000:00010000:2.0:1788830597.353570:0:11161:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e200/0x575506951eea0f72 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661d53 expref: 47 pid: 5833 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788830597.353632:0:11161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 41 00000100:00100000:2.0:1788830597.353640:0:11161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257ffdc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+47:2355:x1875724578359808:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788830597.353653:0:11161:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788830597.353658:0:11161:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e200/0x575506951eea0f72 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661d53 expref: 47 pid: 5833 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830597.353668:0:11161:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e200/0x575506951eea0f72 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661d53 expref: 47 pid: 5833 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830597.353689:0:11161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e200/0x575506951eea0f72 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661d53 expref: 47 pid: 5833 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830597.353753:0:11161:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e25518dc600) 00010000:00010000:2.0:1788830597.353757:0:11161:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729000/0x575506951eea0f8e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830597.353764:0:11161:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729000/0x575506951eea0f8e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830597.353771:0:11161:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729000/0x575506951eea0f8e lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830597.353800:0:11161:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788830597.353853:0:8202:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729000/0x575506951eea0f8e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788830597.353859:0:11161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257ffdc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+46:2355:x1875724578359808:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 219us (760us total) trans 0 rc 0/0 00010000:00010000:1.0:1788830597.353861:0:8202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729000/0x575506951eea0f8e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788830597.353867:0:11161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 41 00000004:00200000:1.0:1788830597.353920:0:8202:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1788830597.353926:0:8202:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788830597.353953:0:8202:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729000/0x575506951eea0f8e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830597.353991:0:8202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729600/0x575506951eea0f87 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661d5a expref: 46 pid: 8202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830597.354008:0:8202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729000/0x575506951eea0f8e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661d5a expref: 45 pid: 8202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830597.354029:0:8202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e25518dc600) 00010000:00010000:1.0:1788830597.354032:0:8202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788830597.354035:0:8202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2565729000, rc 0) 00000100:00100000:1.0:1788830597.354066:0:8202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257ffdd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+45:10396:x1875724578359680:12345-192.168.201.21@tcp:101:bash.0 Request processed in 3050us (3607us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830597.354072:0:8202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 59 00000100:00100000:2.0:1788830597.356050:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830597.356122:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578360064 00000100:00100000:3.0:1788830597.356134:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578360064 00000100:00100000:3.0:1788830597.356221:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 15 00000100:00100000:3.0:1788830597.356231:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25629b1850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+45:10396:x1875724578360064:12345-192.168.201.21@tcp:35:bash.0 00000100:00100000:3.0:1788830597.356491:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25629b1850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+46:10396:x1875724578360064:12345-192.168.201.21@tcp:35:bash.0 Request processed in 260us (449us total) trans 4294967344 rc 0/0 00000100:00100000:3.0:1788830597.356499:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 15 00000100:00100000:2.0:1788830597.404394:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830597.404593:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578360320 00000100:00100000:3.0:1788830597.404619:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578360320 00000100:00100000:3.0:1788830597.404694:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 60 00000100:00100000:3.0:1788830597.404781:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257ffde300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+46:10406:x1875724578360320:12345-192.168.201.21@tcp:101:lfs.0 00010000:00010000:3.0:1788830597.404815:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788830597.404843:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d80fe00/0x575506951eea0f95 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa578910534661d61 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830597.404968:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d80e200/0x575506951eea0f9c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830597.404983:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d80e200/0x575506951eea0f9c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830597.404994:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d80e200/0x575506951eea0f9c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788830597.405003:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1788830597.405364:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d80fe00/0x575506951eea0f95 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661d61 expref: 49 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830597.405390:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d80e200/0x575506951eea0f9c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661d61 expref: 48 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830597.405399:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e25518dc500) 00010000:00010000:3.0:1788830597.405403:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788830597.405406:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e257d80e200, rc 0) 00000100:00100000:3.0:1788830597.405482:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257ffde300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+48:10406:x1875724578360320:12345-192.168.201.21@tcp:101:lfs.0 Request processed in 706us (1103us total) trans 4294967345 rc 0/0 00000100:00100000:3.0:1788830597.405490:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 60 00000100:00100000:2.0:1788830597.408195:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830597.409340:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578360448 00000100:00100000:0.0:1788830597.409358:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578360448 00000100:00100000:0.0:1788830597.409448:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 61 00000100:00100000:0.0:1788830597.409461:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257ffdc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+48:10406:x1875724578360448:12345-192.168.201.21@tcp:34:lfs.0 00010000:00010000:0.0:1788830597.409562:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e400/0x575506951eea0faa lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830597.409582:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e400/0x575506951eea0faa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830597.409597:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e400/0x575506951eea0faa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830597.409991:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ec00/0x575506951eea0fb1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830597.410001:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ec00/0x575506951eea0fb1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830597.410009:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ec00/0x575506951eea0fb1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830597.410135:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea0fb8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830597.410144:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea0fb8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830597.410690:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea0fb8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788830597.410775:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea0fb8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830597.410791:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e400/0x575506951eea0faa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830597.410798:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e400/0x575506951eea0faa lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830597.410806:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e400/0x575506951eea0faa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830597.410813:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2445b7e400 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:0.0:1788830597.410818:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e400/0x575506951eea0faa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830597.410838:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e400/0x575506951eea0faa lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830597.410853:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e25518dc500) 00010000:00010000:0.0:1788830597.410857:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788830597.410862:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e400/0x575506951eea0faa lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830597.410869:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e400/0x575506951eea0faa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830597.410886:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ec00/0x575506951eea0fb1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830597.410892:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ec00/0x575506951eea0fb1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830597.410898:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ec00/0x575506951eea0fb1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830597.410904:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2445b7ec00 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:0.0:1788830597.410907:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ec00/0x575506951eea0fb1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830597.410914:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ec00/0x575506951eea0fb1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830597.410921:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9e25518dc200) 00010000:00010000:0.0:1788830597.410924:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788830597.410927:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ec00/0x575506951eea0fb1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830597.410945:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ec00/0x575506951eea0fb1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830597.410964:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea0fb8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830597.410971:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea0fb8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830597.410977:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea0fb8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830597.410982:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2445b7ee00 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:0.0:1788830597.410987:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea0fb8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830597.410993:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea0fb8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830597.411002:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e25518dc600) 00010000:00010000:0.0:1788830597.411005:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788830597.411008:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea0fb8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830597.411014:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea0fb8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788830597.412139:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257ffdc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+48:10406:x1875724578360448:12345-192.168.201.21@tcp:34:lfs.0 Request processed in 1688us (2966us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830597.412428:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 61 00000100:00100000:2.0:1788830597.447950:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830597.448528:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578360704 00000100:00100000:1.0:1788830597.448542:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578360704 00000100:00100000:1.0:1788830597.449145:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 62 00000100:00100000:1.0:1788830597.449163:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257ffdfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+48:10409:x1875724578360704:12345-192.168.201.21@tcp:101:lfs.0 00010000:00010000:1.0:1788830597.449196:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788830597.449224:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff400/0x575506951eea0fbf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa578910534661d68 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830597.453251:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe800/0x575506951eea0fc6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830597.453288:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe800/0x575506951eea0fc6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830597.453317:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe800/0x575506951eea0fc6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830597.453345:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea0fcd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830597.453353:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea0fcd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830597.453394:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea0fcd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830597.453563:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffe00/0x575506951eea0fd4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830597.453573:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffe00/0x575506951eea0fd4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830597.453581:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffe00/0x575506951eea0fd4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788830597.453595:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1788830597.453923:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe800/0x575506951eea0fc6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830597.453932:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe800/0x575506951eea0fc6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830597.453939:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe800/0x575506951eea0fc6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830597.453946:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e25820fe800 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:1.0:1788830597.453950:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe800/0x575506951eea0fc6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830597.453959:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe800/0x575506951eea0fc6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830597.453974:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e25518dc500) 00010000:00010000:1.0:1788830597.453977:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788830597.453990:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe800/0x575506951eea0fc6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830597.453997:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe800/0x575506951eea0fc6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830597.454014:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea0fcd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830597.454383:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea0fcd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830597.454389:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea0fcd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830597.454395:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e25820ff800 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:1.0:1788830597.454398:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea0fcd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830597.454406:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea0fcd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830597.454416:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9e257480ce00) 00010000:00010000:1.0:1788830597.454419:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788830597.454422:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea0fcd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830597.454427:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea0fcd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830597.454492:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff400/0x575506951eea0fbf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661d68 expref: 51 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830597.454522:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffe00/0x575506951eea0fd4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661d68 expref: 50 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830597.454529:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e25518dc600) 00010000:00010000:1.0:1788830597.454531:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788830597.454534:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e25820ffe00, rc 0) 00000100:00100000:1.0:1788830597.454802:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257ffdfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+50:10409:x1875724578360704:12345-192.168.201.21@tcp:101:lfs.0 Request processed in 5643us (6867us total) trans 4294967346 rc 0/0 00000100:00100000:1.0:1788830597.454813:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 62 00000100:00100000:2.0:1788830597.461804:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830597.461864:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830597.462029:0:8202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578360960 00000100:00100000:1.0:1788830597.462043:0:8202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578360960 00000100:00100000:1.0:1788830597.462125:0:8202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 63 00000100:00100000:1.0:1788830597.462139:0:8202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257ffdd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+50:10409:x1875724578360960:12345-192.168.201.21@tcp:54:lfs.0 00010000:00010000:1.0:1788830597.462478:0:8202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff400/0x575506951eea0fe2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830597.462503:0:8202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff400/0x575506951eea0fe2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830597.462519:0:8202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff400/0x575506951eea0fe2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830597.462556:0:8202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff400/0x575506951eea0fe2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830597.462564:0:8202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff400/0x575506951eea0fe2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830597.462608:0:8202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff400/0x575506951eea0fe2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830597.462615:0:8202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e25820ff400 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:1.0:1788830597.462621:0:8202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff400/0x575506951eea0fe2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830597.462630:0:8202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff400/0x575506951eea0fe2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830597.462645:0:8202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e25518dc600) 00010000:00010000:1.0:1788830597.462648:0:8202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788830597.462653:0:8202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff400/0x575506951eea0fe2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830597.462659:0:8202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff400/0x575506951eea0fe2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788830597.463123:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578360832 00000100:00100000:3.0:1788830597.463132:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578360832 00000100:00100000:3.0:1788830597.463204:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 4 00000100:00100000:3.0:1788830597.463214:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257ffddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+51:2354:x1875724578360832:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788830597.463241:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788830597.463262:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffe00/0x575506951eea0fd4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661d68 expref: 51 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830597.463276:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e25518dc600) 00010000:00010000:3.0:1788830597.463280:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788830597.463342:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257ffddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+50:2354:x1875724578360832:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 129us (1556us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830597.463349:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 4 00000100:00100000:0.0:1788830597.463437:0:8202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257ffdd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+49:10409:x1875724578360960:12345-192.168.201.21@tcp:54:lfs.0 Request processed in 1300us (1571us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830597.463445:0:8202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 63 00000100:00100000:2.0:1788830597.466148:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830597.466264:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578361216 00000100:00100000:0.0:1788830597.466277:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578361216 00000100:00100000:0.0:1788830597.466357:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 16 00000100:00100000:0.0:1788830597.466371:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257ffde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+49:10409:x1875724578361216:12345-192.168.201.21@tcp:35:lfs.0 00000100:00100000:0.0:1788830597.466853:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257ffde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+50:10409:x1875724578361216:12345-192.168.201.21@tcp:35:lfs.0 Request processed in 483us (718us total) trans 4294967347 rc 0/0 00000100:00100000:0.0:1788830597.466862:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 16 00000100:00100000:2.0:1788830597.511859:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830597.511958:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830597.512001:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830597.512790:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578361472 00000100:00100000:1.0:1788830597.512805:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578361472 00000100:00100000:1.0:1788830597.512907:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 70 00000100:00100000:1.0:1788830597.512919:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257ffddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+5:2355:x1875724578361472:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:1.0:1788830597.513012:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257ffddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+5:2355:x1875724578361472:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 96us (1010us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830597.513020:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 70 00000100:00080000:2.0:1788830597.513118:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788830597.513771:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578361600 00000100:00100000:3.0:1788830597.513780:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578361600 00000100:00100000:3.0:1788830597.513848:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 119 00000100:00100000:3.0:1788830597.513858:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257ffdce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2154ea6-69cb-4a30-aac0-000fba13e98b+5:2355:x1875724578361600:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:3.0:1788830597.513914:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257ffdce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2154ea6-69cb-4a30-aac0-000fba13e98b+5:2355:x1875724578361600:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 59us (1956us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830597.513921:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 119 00000100:00080000:2.0:1788830597.514573:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788830597.516576:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578361344 00000100:00100000:0.0:1788830597.517513:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578361344 00000100:00100000:0.0:1788830597.518325:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 283 00000100:00100000:0.0:1788830597.518353:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2574712c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+13:2355:x1875724578361344:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:0.0:1788830597.518495:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2574712c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+13:2355:x1875724578361344:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 158us (6653us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830597.518560:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 283 00000100:00100000:2.0:1788830597.606885:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830597.607697:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578361856 00000100:00100000:0.0:1788830597.607754:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578361856 00000100:00100000:0.0:1788830597.607846:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 64 00000100:00100000:0.0:1788830597.607860:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257ffdf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+50:10427:x1875724578361856:12345-192.168.201.21@tcp:101:cat.0 00010000:00010000:0.0:1788830597.607893:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788830597.607923:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea0fe9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa578910534661d6f expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830597.608245:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ec00/0x575506951eea0ff0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830597.608273:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ec00/0x575506951eea0ff0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830597.608289:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ec00/0x575506951eea0ff0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788830597.608435:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1788830597.608620:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea0fe9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661d6f expref: 53 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830597.608644:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ec00/0x575506951eea0ff0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661d6f expref: 52 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830597.608654:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e25518dc600) 00010000:00010000:0.0:1788830597.608657:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788830597.608662:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2445b7ec00, rc 0) 00000100:00100000:0.0:1788830597.608865:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257ffdf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+52:10427:x1875724578361856:12345-192.168.201.21@tcp:101:cat.0 Request processed in 1007us (1994us total) trans 4294967348 rc 0/0 00000100:00100000:0.0:1788830597.608873:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 64 00000100:00100000:2.0:1788830597.643035:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830597.643188:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578361984 00000100:00100000:3.0:1788830597.643203:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578361984 00000100:00100000:3.0:1788830597.643282:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 65 00000100:00100000:3.0:1788830597.643305:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257ffdca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+52:10428:x1875724578361984:12345-192.168.201.21@tcp:101:lfs.0 00010000:00010000:3.0:1788830597.643339:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788830597.643366:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d80fe00/0x575506951eea0ffe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa578910534661d76 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830597.643472:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d80e800/0x575506951eea1005 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830597.643490:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d80e800/0x575506951eea1005 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830597.643505:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d80e800/0x575506951eea1005 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788830597.643549:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:3.0:1788830597.643554:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788830597.643576:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d80e800/0x575506951eea1005 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830597.643607:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d80fe00/0x575506951eea0ffe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661d76 expref: 54 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830597.643632:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d80e800/0x575506951eea1005 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661d76 expref: 53 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830597.643642:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e25518dc500) 00010000:00010000:3.0:1788830597.643645:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788830597.643649:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e257d80e800, rc 0) 00000100:00100000:3.0:1788830597.643798:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257ffdca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+53:10428:x1875724578361984:12345-192.168.201.21@tcp:101:lfs.0 Request processed in 505us (778us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830597.643807:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 65 00000100:00100000:3.0:1788830597.649593:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830597.649879:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578362368 00000100:00100000:0.0:1788830597.649893:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578362368 00000100:00100000:0.0:1788830597.649978:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 17 00000100:00100000:0.0:1788830597.649990:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25654d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+53:10428:x1875724578362368:12345-192.168.201.21@tcp:35:lfs.0 00000100:00100000:0.0:1788830597.650459:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25654d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+54:10428:x1875724578362368:12345-192.168.201.21@tcp:35:lfs.0 Request processed in 469us (880us total) trans 4294967349 rc 0/0 00000100:00100000:0.0:1788830597.650469:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 17 00000100:00100000:0.0:1788830597.654232:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830597.654574:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578362496 00000100:00100000:2.0:1788830597.654589:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578362496 00000100:00100000:2.0:1788830597.654680:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 5 00000100:00100000:2.0:1788830597.654694:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25747c0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+54:10428:x1875724578362496:12345-192.168.201.21@tcp:103:lfs.0 00010000:00010000:2.0:1788830597.654752:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788830597.654803:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729000/0x575506951eea0f8e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661d5a expref: 54 pid: 8202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830597.654835:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ec00/0x575506951eea0ff0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661d6f expref: 53 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830597.654851:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea0e99 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661d1b expref: 52 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830597.654863:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e25518dc600) 00010000:00010000:2.0:1788830597.654877:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788830597.655141:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25747c0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+51:10428:x1875724578362496:12345-192.168.201.21@tcp:103:lfs.0 Request processed in 449us (924us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830597.655150:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 5 00000100:00100000:2.0:1788830597.657905:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830597.658225:0:8202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578362624 00000100:00100000:0.0:1788830597.658240:0:8202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578362624 00000100:00100000:0.0:1788830597.658323:0:8202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 66 00000100:00100000:0.0:1788830597.658335:0:8202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257ffdea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+51:10428:x1875724578362624:12345-192.168.201.21@tcp:58:lfs.0 00010000:00010000:0.0:1788830597.658510:0:8202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e400/0x575506951eea100c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830597.658531:0:8202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e400/0x575506951eea100c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830597.658545:0:8202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e400/0x575506951eea100c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788830597.659197:0:8202:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788830597.659474:0:8202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:0.0:1788830597.659553:0:8202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:0.0:1788830597.660744:0:8202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257ffdea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+51:10428:x1875724578362624:12345-192.168.201.21@tcp:58:lfs.0 Request processed in 1370us (1813us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830597.660862:0:8202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 66 00000100:00100000:3.0:1788830597.686508:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830597.686746:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578362752 00000100:00100000:1.0:1788830597.686758:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578362752 00000100:00100000:1.0:1788830597.686851:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 67 00000100:00100000:1.0:1788830597.686862:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25654d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+51:10430:x1875724578362752:12345-192.168.201.21@tcp:101:lfs.0 00010000:00010000:1.0:1788830597.686900:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788830597.686928:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff400/0x575506951eea1013 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa578910534661d7d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830597.687046:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea101a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830597.687067:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea101a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830597.687094:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea101a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830597.687114:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe800/0x575506951eea1021 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830597.687122:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe800/0x575506951eea1021 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830597.687130:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe800/0x575506951eea1021 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830597.687252:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea1028 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830597.687262:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea1028 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830597.687269:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea1028 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788830597.687319:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1788830597.687331:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788830597.687360:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea1028 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830597.687376:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea1028 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830597.687385:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea101a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830597.687391:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea101a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830597.687398:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea101a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830597.687405:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e25820ff800 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:1.0:1788830597.687410:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea101a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830597.687418:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea101a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830597.687433:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e25518dc500) 00010000:00010000:1.0:1788830597.687436:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788830597.687441:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea101a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830597.687447:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea101a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830597.687463:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe800/0x575506951eea1021 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830597.687482:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe800/0x575506951eea1021 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830597.687487:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe800/0x575506951eea1021 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830597.687493:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e25820fe800 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:1.0:1788830597.687497:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe800/0x575506951eea1021 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830597.687515:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe800/0x575506951eea1021 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830597.687525:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9e257480ce00) 00010000:00010000:1.0:1788830597.687528:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788830597.687531:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe800/0x575506951eea1021 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830597.687537:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe800/0x575506951eea1021 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830597.687583:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff400/0x575506951eea1013 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661d7d expref: 53 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830597.687598:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea1028 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661d7d expref: 52 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830597.687607:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e25518dc200) 00010000:00010000:1.0:1788830597.687609:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788830597.687619:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e25820fe400, rc 0) 00000100:00100000:1.0:1788830597.687774:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25654d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+52:10430:x1875724578362752:12345-192.168.201.21@tcp:101:lfs.0 Request processed in 850us (1229us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830597.687782:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 67 00000100:00100000:1.0:1788830597.856076:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2565cc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875724595164544:0@lo:400:kworker.0 00000100:00100000:1.0:1788830597.856181:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830597.856248:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788830597.856253:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257e927800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875724595164672:0@lo:400:kworker.0 00000100:00100000:1.0:1788830597.856274:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830597.856304:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595164544 00000100:00100000:1.0:1788830597.856312:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595164544 00000100:00100000:1.0:1788830597.856361:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788830597.856369:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257e924700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875724595164544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788830597.856417:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257e924700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875724595164544:12345-0@lo:400:kworker.0 Request processed in 49us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830597.856422:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788830597.856444:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595164672 00000100:00100000:1.0:1788830597.856447:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595164672 00000100:00100000:1.0:1788830597.856474:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788830597.856478:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257e926300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875724595164672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788830597.856496:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257e926300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875724595164672:12345-0@lo:400:kworker.0 Request processed in 19us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830597.856500:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00080000:1.0:1788830597.856515:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788830597.856541:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257e927800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875724595164672:0@lo:400:kworker.0 00000100:00100000:1.0:1788830597.856548:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2565cc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875724595164544:0@lo:400:kworker.0 00000100:00100000:0.0:1788830597.857099:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2565cc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875724595164416:0@lo:400:kworker.0 00000100:00100000:0.0:1788830597.857137:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830597.857156:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257e924a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875724595164928:0@lo:400:kworker.0 00000100:00100000:0.0:1788830597.857173:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830597.857195:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788830597.857199:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2565cc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1745cc3d-3952-4cd4-9020-9b8acb483105:3308:1875724595164288:0@lo:400:kworker.0 00000100:00100000:0.0:1788830597.857220:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830597.857234:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257e924000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1875724595164800:0@lo:400:kworker.0 00000100:00100000:0.0:1788830597.857248:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830597.857282:0:8202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595164416 00000100:00100000:0.0:1788830597.857285:0:8202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595164416 00000100:00100000:0.0:1788830597.857309:0:8202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595164800 00000100:00100000:0.0:1788830597.857310:0:8202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595164800 00000100:00100000:0.0:1788830597.857327:0:8202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788830597.857332:0:8202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25747c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875724595164416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788830597.857360:0:8202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25747c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875724595164416:12345-0@lo:400:kworker.0 Request processed in 28us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830597.857364:0:8202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788830597.857373:0:8202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788830597.857377:0:8202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25747c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875724595164800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788830597.857391:0:8202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25747c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875724595164800:12345-0@lo:400:kworker.0 Request processed in 14us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830597.857395:0:8202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788830597.857406:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595164928 00000100:00100000:0.0:1788830597.857409:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595164928 00000100:00100000:0.0:1788830597.857423:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788830597.857426:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25747c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3308:x1875724595164928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788830597.857444:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25747c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3308:x1875724595164928:12345-0@lo:400:kworker.0 Request processed in 17us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830597.857448:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788830597.857458:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595164288 00000100:00100000:0.0:1788830597.857460:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595164288 00000100:00100000:0.0:1788830597.857477:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1788830597.857481:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2574710850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1745cc3d-3952-4cd4-9020-9b8acb483105+19:3308:x1875724595164288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788830597.857497:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2574710850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1745cc3d-3952-4cd4-9020-9b8acb483105+19:3308:x1875724595164288:12345-0@lo:400:kworker.0 Request processed in 17us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830597.857509:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00080000:0.0:1788830597.857536:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788830597.857558:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2565cc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1745cc3d-3952-4cd4-9020-9b8acb483105:3308:1875724595164288:0@lo:400:kworker.0 00000100:00100000:0.0:1788830597.857568:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257e924000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1875724595164800:0@lo:400:kworker.0 00000100:00100000:0.0:1788830597.857575:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2565cc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875724595164416:0@lo:400:kworker.0 00000100:00100000:0.0:1788830597.857582:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257e924a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875724595164928:0@lo:400:kworker.0 00010000:00010000:0.0:1788830598.171928:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788830598.364051:0:11676:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788830598.364069:0:11676:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788830598.364135:0:11676:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1788830598.364147:0:11676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788830598.364323:0:11676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257ffded80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11676:1875724595165056:192.168.201.21@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788830598.364456:0:11676:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e25531c3d80 going to sleep for 11 seconds 00000004:00080000:2.0:1788830598.364635:0:7644:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 351711924208ns, next at 352711921760ns, rc = 0 00000100:00100000:2.0:1788830598.364662:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788830598.364675:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257ffdf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875724595165184:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788830598.364747:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788830598.364890:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595165184 00000100:00100000:2.0:1788830598.364898:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595165184 00000100:00100000:2.0:1788830598.364961:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788830598.364971:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257ffdf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1875724595165184:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788830598.365011:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788830598.366210:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257ffdf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1875724595165184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1229us (1452us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830598.366225:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:2.0:1788830598.366254:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788830598.366334:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257ffdf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875724595165184:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788830598.375266:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830598.375283:0:11676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257ffded80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11676:1875724595165056:192.168.201.21@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788830598.375522:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578362880 00000100:00100000:1.0:1788830598.375531:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578362880 00000100:00100000:1.0:1788830598.375600:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 1 00000100:00100000:1.0:1788830598.375612:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257ffdf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+52:10441:x1875724578362880:12345-192.168.201.21@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1788830598.375755:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257ffdf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+52:10441:x1875724578362880:12345-192.168.201.21@tcp:900:lhsmtool_posix.0 Request processed in 144us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830598.375764:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 1 00000100:00100000:2.0:1788830598.395035:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830598.395955:0:8202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578363008 00000100:00100000:1.0:1788830598.395970:0:8202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578363008 00000100:00100000:1.0:1788830598.396051:0:8202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 68 00000100:00100000:1.0:1788830598.396074:0:8202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257ffded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+52:10441:x1875724578363008:12345-192.168.201.21@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788830598.396118:0:8202:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788830598.396260:0:8202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257ffded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+52:10441:x1875724578363008:12345-192.168.201.21@tcp:53:lhsmtool_posix.0 Request processed in 197us (1238us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830598.396269:0:8202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 68 00000100:00100000:1.0:1788830598.403296:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830598.406237:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578363136 00000100:00100000:0.0:1788830598.406256:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578363136 00000100:00100000:0.0:1788830598.406345:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 69 00000100:00100000:0.0:1788830598.406359:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257e927800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+52:10441:x1875724578363136:12345-192.168.201.21@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788830598.406463:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ec00/0x575506951eea102f lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830598.406485:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ec00/0x575506951eea102f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830598.406500:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ec00/0x575506951eea102f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830598.406570:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea1036 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830598.406577:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea1036 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830598.406597:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea1036 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830598.406626:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e200/0x575506951eea103d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830598.406632:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e200/0x575506951eea103d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830598.406637:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e200/0x575506951eea103d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788830598.406680:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1788830598.406685:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788830598.406697:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e200/0x575506951eea103d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830598.406730:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ec00/0x575506951eea102f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830598.406739:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ec00/0x575506951eea102f lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830598.406747:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ec00/0x575506951eea102f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830598.406754:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2445b7ec00 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:0.0:1788830598.406759:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ec00/0x575506951eea102f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830598.406768:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ec00/0x575506951eea102f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830598.406791:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e257480cd00) 00010000:00010000:0.0:1788830598.406794:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788830598.406800:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ec00/0x575506951eea102f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830598.406806:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ec00/0x575506951eea102f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830598.406818:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea1036 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830598.406825:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea1036 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830598.406830:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea1036 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830598.406835:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2445b7ee00 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:0.0:1788830598.406839:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea1036 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830598.406845:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea1036 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830598.406853:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff9e25518dc600) 00010000:00010000:0.0:1788830598.406855:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788830598.406858:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea1036 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830598.406864:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea1036 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830598.406902:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e200/0x575506951eea103d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830598.406906:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e200/0x575506951eea103d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830598.406910:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e200/0x575506951eea103d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830598.406913:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2445b7e200 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:0.0:1788830598.406915:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e200/0x575506951eea103d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830598.406918:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e200/0x575506951eea103d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830598.406923:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e25518dc200) 00010000:00010000:0.0:1788830598.406925:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788830598.406927:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e200/0x575506951eea103d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830598.406931:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e200/0x575506951eea103d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788830598.407019:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257e927800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+52:10441:x1875724578363136:12345-192.168.201.21@tcp:34:lhsmtool_posix.0 Request processed in 662us (3736us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830598.407026:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 69 00000100:00100000:1.0:1788830598.415083:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830598.415176:0:8202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578363392 00000100:00100000:3.0:1788830598.415194:0:8202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578363392 00000100:00100000:3.0:1788830598.415266:0:8202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 70 00000100:00100000:3.0:1788830598.415281:0:8202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257e927480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+52:10441:x1875724578363392:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788830598.415301:0:8202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788830598.415321:0:8202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d80fe00/0x575506951eea1044 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa578910534661d84 expref: -99 pid: 8202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830598.415440:0:8202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944000/0x575506951eea104b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830598.415456:0:8202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944000/0x575506951eea104b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830598.415468:0:8202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944000/0x575506951eea104b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788830598.415479:0:8202:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788830598.415580:0:8202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944000/0x575506951eea104b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830598.415588:0:8202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944000/0x575506951eea104b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830598.415595:0:8202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944000/0x575506951eea104b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830598.415601:0:8202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e257d944000 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:3.0:1788830598.415605:0:8202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944000/0x575506951eea104b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830598.415613:0:8202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944000/0x575506951eea104b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830598.415638:0:8202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e25518dc200) 00010000:00010000:3.0:1788830598.415642:0:8202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788830598.415647:0:8202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944000/0x575506951eea104b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830598.415653:0:8202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944000/0x575506951eea104b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830598.415699:0:8202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d80fe00/0x575506951eea1044 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661d84 expref: 54 pid: 8202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830598.415739:0:8202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e257480cd00) 00010000:00010000:3.0:1788830598.415742:0:8202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788830598.415747:0:8202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d80fe00/0x575506951eea1044 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661d84 expref: 54 pid: 8202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830598.415758:0:8202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e257d80fe00, rc 0) 00000100:00100000:3.0:1788830598.415828:0:8202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257e927480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+53:10441:x1875724578363392:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 Request processed in 552us (770us total) trans 4294967350 rc 301/301 00000100:00100000:3.0:1788830598.415836:0:8202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 70 00000100:00100000:3.0:1788830598.419792:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830598.419876:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578363520 00000100:00100000:1.0:1788830598.419894:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578363520 00000100:00100000:1.0:1788830598.419986:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 71 00000100:00100000:1.0:1788830598.419999:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25654d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+53:10441:x1875724578363520:12345-192.168.201.21@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788830598.420067:0:5834:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788830598.420399:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25654d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+53:10441:x1875724578363520:12345-192.168.201.21@tcp:53:lhsmtool_posix.0 Request processed in 402us (617us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830598.420408:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 71 00000100:00100000:1.0:1788830598.427390:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830598.427452:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578363776 00000100:00100000:1.0:1788830598.427466:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578363776 00000100:00100000:1.0:1788830598.427544:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 72 00000100:00100000:1.0:1788830598.427557:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257e924e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+53:10441:x1875724578363776:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788830598.427587:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788830598.427591:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788830598.427627:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d80e800/0x575506951eea1005 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661d76 expref: 53 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830598.427652:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e25518dc500) 00010000:00010000:1.0:1788830598.427658:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788830598.427674:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffe00/0x575506951eea1059 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa578910534661d8b expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788830598.428461:0:5832:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:1.0:1788830598.428794:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff400/0x575506951eea1060 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830598.428813:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff400/0x575506951eea1060 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830598.428828:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff400/0x575506951eea1060 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830598.428904:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffe00/0x575506951eea1059 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661d8b expref: 55 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830598.428922:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff400/0x575506951eea1060 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661d8b expref: 54 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830598.428938:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9e257480cb00) 00010000:00010000:1.0:1788830598.428942:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788830598.428945:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e25820ff400, rc 0) 00000100:00100000:1.0:1788830598.429035:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257e924e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+54:10441:x1875724578363776:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 Request processed in 1480us (1658us total) trans 4294967351 rc 0/0 00000100:00100000:1.0:1788830598.429045:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 72 00000040:00080000:2.0:1788830598.436440:0:11994:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788830598.436452:0:11994:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788830598.438692:0:11994:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1788830598.438719:0:11994:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788830598.446840:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830598.447004:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578364032 00000100:00100000:2.0:1788830598.447021:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578364032 00000100:00100000:2.0:1788830598.447139:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 73 00000100:00100000:2.0:1788830598.447158:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257e926a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+54:10441:x1875724578364032:12345-192.168.201.21@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788830598.447237:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788830598.447275:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff400/0x575506951eea1060 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661d8b expref: 54 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830598.447319:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9e257480cb00) 00010000:00010000:2.0:1788830598.447340:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788830598.447370:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729400/0x575506951eea106e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830598.447389:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729400/0x575506951eea106e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830598.447402:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729400/0x575506951eea106e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830598.447422:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728c00/0x575506951eea1075 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xd66cafd2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830598.447431:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728c00/0x575506951eea1075 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xd66cafd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830598.447439:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728c00/0x575506951eea1075 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xd66cafd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830598.447528:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729400/0x575506951eea106e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830598.447537:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729400/0x575506951eea106e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830598.447544:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729400/0x575506951eea106e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830598.447551:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2565729400 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:2.0:1788830598.447556:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729400/0x575506951eea106e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830598.447574:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729400/0x575506951eea106e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830598.447583:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e25518dc500) 00010000:00010000:2.0:1788830598.447586:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788830598.447590:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729400/0x575506951eea106e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830598.447596:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729400/0x575506951eea106e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830598.447607:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728c00/0x575506951eea1075 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xd66cafd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830598.447614:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728c00/0x575506951eea1075 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xd66cafd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830598.447620:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728c00/0x575506951eea1075 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xd66cafd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830598.447626:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2565728c00 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:2.0:1788830598.447629:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728c00/0x575506951eea1075 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xd66cafd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830598.447636:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728c00/0x575506951eea1075 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xd66cafd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830598.447643:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xd66cafd2 (ffff9e2551f3e000) 00010000:00010000:2.0:1788830598.447646:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788830598.447649:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728c00/0x575506951eea1075 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xd66cafd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830598.447665:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728c00/0x575506951eea1075 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xd66cafd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788830598.447810:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257e926a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+53:10441:x1875724578364032:12345-192.168.201.21@tcp:36:lhsmtool_posix.0 Request processed in 657us (976us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788830598.447822:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 73 00000100:00100000:1.0:1788830598.450095:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830598.450161:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578364160 00000100:00100000:3.0:1788830598.450170:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578364160 00000100:00100000:3.0:1788830598.450227:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 74 00000100:00100000:3.0:1788830598.450239:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257e927b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+53:10441:x1875724578364160:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788830598.450260:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788830598.450282:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944000/0x575506951eea107c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa578910534661d92 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830598.450329:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944a00/0x575506951eea1083 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830598.450343:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944a00/0x575506951eea1083 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830598.450354:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944a00/0x575506951eea1083 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830598.450450:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944000/0x575506951eea107c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661d92 expref: 55 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830598.450471:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944a00/0x575506951eea1083 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661d92 expref: 54 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830598.450479:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9e25530b0900) 00010000:00010000:3.0:1788830598.450482:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788830598.450486:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e257d944a00, rc 0) 00000100:00100000:3.0:1788830598.450558:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257e927b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+54:10441:x1875724578364160:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 Request processed in 319us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830598.450566:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 74 00000100:00100000:0.0:1788830598.466849:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830598.466929:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578364416 00000100:00100000:3.0:1788830598.466947:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578364416 00000100:00100000:3.0:1788830598.467222:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 75 00000100:00100000:3.0:1788830598.467235:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25747c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+54:10441:x1875724578364416:12345-192.168.201.21@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788830598.467382:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944000/0x575506951eea108a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830598.467415:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944000/0x575506951eea108a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830598.467431:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944000/0x575506951eea108a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788830598.467931:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:3.0:1788830598.467945:0:5834:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 351815235124ns, next at 352815232639ns, rc = 0 00000004:00010000:3.0:1788830598.468071:0:5834:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000055eb8c49 reply state 00000000e9126be4 transno 4294967352 ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944000/0x575506951eea108a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788830598.468083:0:5834:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788830598.468225:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25747c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+56:10441:x1875724578364416:12345-192.168.201.21@tcp:36:lhsmtool_posix.0 Request processed in 989us (1383us total) trans 4294967352 rc 0/0 00000100:00100000:3.0:1788830598.468234:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 75 00000100:00100000:0.0:1788830598.477269:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830598.477311:0:8202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578364544 00000100:00100000:0.0:1788830598.477332:0:8202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578364544 00000100:00100000:0.0:1788830598.477395:0:8202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 76 00000100:00100000:0.0:1788830598.477405:0:8202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25747c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+56:10441:x1875724578364544:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788830598.477436:0:8202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788830598.477461:0:8202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ec00/0x575506951eea1091 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa578910534661d99 expref: -99 pid: 8202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830598.477549:0:8202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ec00/0x575506951eea1091 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661d99 expref: 57 pid: 8202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830598.477566:0:8202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ec00/0x575506951eea1091 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661d99 expref: 57 pid: 8202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830598.477587:0:8202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9e25530b0900) 00010000:00010000:0.0:1788830598.477591:0:8202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788830598.477595:0:8202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2445b7ec00, rc 0) 00000100:00100000:0.0:1788830598.477656:0:8202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25747c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+57:10441:x1875724578364544:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 Request processed in 251us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830598.477663:0:8202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 76 00010000:00010000:3.0:1788830598.478301:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944000/0x575506951eea108a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830598.478315:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944000/0x575506951eea108a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830598.478322:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944000/0x575506951eea108a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830598.478329:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e257d944000 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:3.0:1788830598.478334:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944000/0x575506951eea108a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830598.478343:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944000/0x575506951eea108a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830598.478374:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9e25530b0900) 00010000:00010000:3.0:1788830598.478377:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788830598.478381:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944000/0x575506951eea108a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830598.478387:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944000/0x575506951eea108a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788830598.481179:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830598.481365:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578364672 00000100:00100000:2.0:1788830598.481378:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578364672 00000100:00100000:2.0:1788830598.481436:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 26 00000100:00100000:2.0:1788830598.481445:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25747c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2351:x1875724578364672:12345-192.168.201.21@tcp:8:lhsmtool_posix.0 00010000:00080000:2.0:1788830598.481498:0:6680:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 1ef2fe7a-e5ec-4085-8326-b72aa00876cd@192.168.201.21@tcp t0 exp 0000000000000000 cur 351 last 0 00000020:00000080:2.0:1788830598.481539:0:6680:0:(genops.c:1385:class_connect()) connect: client 1ef2fe7a-e5ec-4085-8326-b72aa00876cd, cookie 0x575506951eea1098 00002000:00100000:2.0:1788830598.481555:0:6680:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 1ef2fe7a-e5ec-4085-8326-b72aa00876cd/ffff9e255179a800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113968 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788830598.481569:0:6680:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788830598.481906:0:6680:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788830598.481959:0:6680:0:(import.c:65:import_set_state_nolock()) ffff9e2551798000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788830598.482074:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25747c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+6:2351:x1875724578364672:12345-192.168.201.21@tcp:8:lhsmtool_posix.0 Request processed in 627us (907us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830598.482082:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 26 00000100:00100000:0.0:1788830598.501452:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830598.501606:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578364800 00000100:00100000:2.0:1788830598.501621:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578364800 00000100:00080000:0.0:1788830598.501672:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788830598.501742:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 27 00000100:00100000:2.0:1788830598.501757:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25747c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+6:0:x1875724578364800:12345-192.168.201.21@tcp:2:lhsmtool_posix.0 00000001:00080000:0.0:1788830598.538127:0:6709:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000001:00100000:0.0:1788830598.538150:0:6709:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 1ef2fe7a-e5ec-4085-8326-b72aa00876cd 00000100:00100000:2.0:1788830598.538502:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25747c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+5:0:x1875724578364800:12345-192.168.201.21@tcp:2:lhsmtool_posix.0 Request processed in 36740us (37798us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1788830598.538534:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 27 00000100:00100000:3.0:1788830598.543594:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830598.559360:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578365056 00000100:00100000:1.0:1788830598.559378:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578365056 00000100:00100000:1.0:1788830598.559493:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 18 00000100:00100000:1.0:1788830598.559510:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25654d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+56:10441:x1875724578365056:12345-192.168.201.21@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788830598.559838:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25654d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+57:10441:x1875724578365056:12345-192.168.201.21@tcp:35:lhsmtool_posix.0 Request processed in 329us (16258us total) trans 4294967353 rc 0/0 00000100:00100000:1.0:1788830598.559853:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 18 00000100:00100000:1.0:1788830598.569144:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830598.569226:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578365312 00000100:00100000:2.0:1788830598.569244:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578365312 00000100:00100000:2.0:1788830598.569492:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 77 00000100:00100000:2.0:1788830598.569506:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257e925500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+57:10441:x1875724578365312:12345-192.168.201.21@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788830598.569670:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257e925500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+57:10441:x1875724578365312:12345-192.168.201.21@tcp:57:lhsmtool_posix.0 Request processed in 167us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830598.569679:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 77 00000100:00100000:3.0:1788830598.577391:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830598.577445:0:8202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578365440 00000100:00100000:3.0:1788830598.577459:0:8202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578365440 00000100:00100000:3.0:1788830598.577536:0:8202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 78 00000100:00100000:3.0:1788830598.577549:0:8202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25654d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+57:10441:x1875724578365440:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788830598.577578:0:8202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788830598.577604:0:8202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944200/0x575506951eea109f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa578910534661da0 expref: -99 pid: 8202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830598.577700:0:8202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944000/0x575506951eea10a6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830598.577742:0:8202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944000/0x575506951eea10a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830598.577757:0:8202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944000/0x575506951eea10a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788830598.577803:0:8202:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788830598.577828:0:8202:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944000/0x575506951eea10a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830598.577871:0:8202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944200/0x575506951eea109f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661da0 expref: 59 pid: 8202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830598.577895:0:8202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944000/0x575506951eea10a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661da0 expref: 58 pid: 8202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830598.577904:0:8202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9e25530b0900) 00010000:00010000:3.0:1788830598.577908:0:8202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788830598.577912:0:8202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e257d944000, rc 0) 00000100:00100000:3.0:1788830598.577991:0:8202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25654d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+58:10441:x1875724578365440:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 Request processed in 446us (618us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830598.577999:0:8202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 78 00000100:00100000:1.0:1788830598.581241:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830598.581370:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578365568 00000100:00100000:0.0:1788830598.581387:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578365568 00000100:00100000:0.0:1788830598.582760:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 28 00000100:00100000:0.0:1788830598.582784:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257e925f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+5:2355:x1875724578365568:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788830598.582816:0:6677:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788830598.582851:0:6677:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000347152c2/0x575506951eea10ad lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa578910534661da7 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788830598.582880:0:6677:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9f6386, blocks: 0x1 00010000:00010000:0.0:1788830598.582900:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=351s v=(0 0) 00010000:00010000:0.0:1788830598.582904:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788830598.582913:0:6677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000347152c2/0x575506951eea10ad lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661da7 expref: 6 pid: 6677 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830598.582931:0:6677:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000347152c2/0x575506951eea10ad lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661da7 expref: 6 pid: 6677 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830598.582948:0:6677:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2445b7ee00, rc 0) 00000100:00100000:0.0:1788830598.583030:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257e925f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+6:2355:x1875724578365568:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 Request processed in 257us (1801us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830598.583047:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 28 00000100:00100000:3.0:1788830598.589587:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830598.589765:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578365824 00000100:00100000:0.0:1788830598.589779:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578365824 00000100:00100000:0.0:1788830598.589864:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 79 00000100:00100000:0.0:1788830598.589879:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25654d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+58:10441:x1875724578365824:12345-192.168.201.21@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788830598.590032:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25654d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+58:10441:x1875724578365824:12345-192.168.201.21@tcp:57:lhsmtool_posix.0 Request processed in 156us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830598.590178:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 79 00000100:00100000:1.0:1788830598.601565:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830598.601693:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578365952 00000100:00100000:0.0:1788830598.601746:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578365952 00000100:00100000:0.0:1788830598.601824:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 29 00000100:00100000:0.0:1788830598.601844:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257e924a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+6:10441:x1875724578365952:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788830598.601868:0:6679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788830598.601892:0:6679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000021b17be4/0x575506951eea10b4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa578910534661dae expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830598.601932:0:6679:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000347152c2/0x575506951eea10ad lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661da7 expref: 7 pid: 6677 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830598.601941:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788830598.601946:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788830598.601952:0:6679:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000021b17be4/0x575506951eea10b4 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661dae expref: 7 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830598.601995:0:6679:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000347152c2/0x575506951eea10ad lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.21@tcp remote: 0xa578910534661da7 expref: 7 pid: 6677 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830598.602009:0:6679:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000347152c2/0x575506951eea10ad lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661da7 expref: 7 pid: 6677 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788830598.602026:0:6679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25747c1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6679:1875724595165312:192.168.201.21@tcp:104: 00000100:00100000:0.0:1788830598.602168:0:6679:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2547eab780 going to sleep for 11 seconds 00000100:00100000:0.0:1788830598.609304:0:6679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25747c1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6679:1875724595165312:192.168.201.21@tcp:104: 00010000:00010000:0.0:1788830598.609357:0:6679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000021b17be4/0x575506951eea10b4 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.21@tcp remote: 0xa578910534661dae expref: 7 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830598.609403:0:6679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2445b7e200, rc 0) 00000100:00100000:0.0:1788830598.609482:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257e924a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+7:10441:x1875724578365952:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 Request processed in 7640us (7932us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830598.609492:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 29 00000100:00100000:3.0:1788830598.610344:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830598.610476:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578366080 00000100:00100000:0.0:1788830598.610486:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578366080 00010000:00010000:0.0:1788830598.610528:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000347152c2/0x575506951eea10ad lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661da7 expref: 7 pid: 6677 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788830598.610574:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 42 00000100:00100000:0.0:1788830598.610585:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2547437450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+7:2354:x1875724578366080:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788830598.610604:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788830598.610636:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000347152c2/0x575506951eea10ad lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661da7 expref: 7 pid: 6677 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830598.610649:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000347152c2/0x575506951eea10ad lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661da7 expref: 7 pid: 6677 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830598.610678:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000347152c2/0x575506951eea10ad lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661da7 expref: 7 pid: 6677 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830598.610696:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788830598.610701:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788830598.610747:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000021b17be4/0x575506951eea10b4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.21@tcp remote: 0xa578910534661dae expref: 6 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830598.610771:0:5818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000021b17be4/0x575506951eea10b4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.21@tcp remote: 0xa578910534661dae expref: 6 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830598.610817:0:5818:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000021b17be4/0x575506951eea10b4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.21@tcp remote: 0xa578910534661dae expref: 6 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788830598.611032:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25747c1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5818:1875724595165440:192.168.201.21@tcp:105: 00000100:00100000:0.0:1788830598.611203:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2547eab780 going to sleep for 11 seconds 00000100:00100000:3.0:1788830598.626246:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830598.626418:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578366208 00000100:00100000:1.0:1788830598.626431:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578366208 00002000:00100000:1.0:1788830598.626495:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9e25654d2300 x1875724578366208/t0(0) o4->1ef2fe7a-e5ec-4085-8326-b72aa00876cd@192.168.201.21@tcp:49/0 lens 504/0 e 0 to 0 dl 1788830609 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788830598.626509:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e25654d2300 with x1875724578366208 ext(0->8) 00002000:00010000:1.0:1788830598.626516:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e25654d2300 00000100:00100000:1.0:1788830598.626570:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 0 00000100:00100000:1.0:1788830598.626582:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25654d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+7:2354:x1875724578366208:12345-192.168.201.21@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788830598.627091:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25747c1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5818:1875724595165440:192.168.201.21@tcp:105: 00010000:00010000:0.0:1788830598.627125:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788830598.627198:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2547437450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+8:2354:x1875724578366080:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 16613us (16860us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830598.627209:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 42 00000100:00100000:1.0:1788830598.627750:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25654d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+8:2354:x1875724578366208:12345-192.168.201.21@tcp:4:lhsmtool_posix.0 Request processed in 1121us (1471us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1788830598.627762:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 0 00002000:00100000:1.0:1788830598.627773:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9e25654d2300 x1875724578366208/t4294967302(0) o4->1ef2fe7a-e5ec-4085-8326-b72aa00876cd@192.168.201.21@tcp:49/0 lens 504/448 e 0 to 0 dl 1788830609 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788830598.627781:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e25654d2300 with x1875724578366208 ext(0->8) 00002000:00010000:1.0:1788830598.627786:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e25654d2300 00000100:00100000:0.0:1788830598.639816:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830598.641879:0:8202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578366336 00000100:00100000:2.0:1788830598.641894:0:8202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578366336 00000100:00100000:2.0:1788830598.642030:0:8202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 80 00000100:00100000:2.0:1788830598.642043:0:8202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25747c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+58:10441:x1875724578366336:12345-192.168.201.21@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1788830598.686774:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967349 is committed 00000001:00080000:3.0:1788830598.686812:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967353 is committed 00000004:00080000:3.0:1788830598.686851:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:3.0:1788830598.686871:0:5855:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9e2548034480 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:3.0:1788830598.686876:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9e2544fa9900 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9e2548034d80 00000020:00080000:3.0:1788830598.686880:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9e2544fa9600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9e2565b47c00 00000004:00080000:3.0:1788830598.686899:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000004:00080000:3.0:1788830598.686912:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:3.0:1788830598.687075:0:5866:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000100:00100000:1.0:1788830598.687166:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257e924000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875724595165568:0@lo:6:osp-syn-1-0.0 00000020:00080000:3.0:1788830598.687221:0:5866:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:1.0:1788830598.687265:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788830598.687491:0:8202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25747c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+14:10441:x1875724578366336:12345-192.168.201.21@tcp:44:lhsmtool_posix.0 Request processed in 45446us (47685us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830598.687504:0:8202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 80 00000100:00100000:1.0:1788830598.687779:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2565cc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875724595165696:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1788830598.687823:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830598.689076:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595165568 00000100:00100000:2.0:1788830598.689094:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595165696 00000100:00100000:0.0:1788830598.689094:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595165568 00000100:00100000:2.0:1788830598.689099:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595165696 00000100:00100000:0.0:1788830598.689156:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788830598.689167:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2565cc1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3310:x1875724595165568:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788830598.689207:0:6677:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:0.0:1788830598.689259:0:6677:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a9f6383, atime: 0x6a9f6383, ctime: 0x6a9f6383, blocks: 0xb 00000100:00080000:1.0:1788830598.689359:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788830598.689387:0:6677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000347152c2/0x575506951eea10bb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830598.689410:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=352s v=(0 0) 00000100:00100000:2.0:1788830598.689423:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00010000:00010000:0.0:1788830598.689432:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788830598.689441:0:6677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000347152c2/0x575506951eea10bb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830598.689461:0:6677:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000347152c2/0x575506951eea10bb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830598.689473:0:6677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000347152c2/0x575506951eea10bb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830598.689481:0:6677:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000347152c2/0x575506951eea10bb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830598.689542:0:6677:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788830598.690041:0:6680:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1788830598.690082:0:6680:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1788830598.690155:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2565cc1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3310:x1875724595165568:12345-0@lo:6:osp-syn-1-0.0 Request processed in 987us (2888us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1788830598.690164:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788830598.690186:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578366464 00000100:00100000:0.0:1788830598.690192:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578366464 00000100:00100000:0.0:1788830598.690213:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788830598.690220:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2565cc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875724595165696:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1788830598.690415:0:6677:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1788830598.690419:0:6677:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788830598 00002000:00010000:0.0:1788830598.690422:0:6677:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788830598.690424:0:6677:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1788830598 -> 1788830598 00002000:00010000:0.0:1788830598.690426:0:6677:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1788830598.690459:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2565cc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3307:x1875724595165696:12345-0@lo:2:osp-syn-0-0.0 Request processed in 239us (2635us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1788830598.690473:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788830598.690489:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 32 00000100:00100000:0.0:1788830598.690496:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257ffdc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+8:2354:x1875724578366464:12345-192.168.201.21@tcp:16:lhsmtool_posix.0 00000004:00080000:2.0:1788830598.690522:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e2565cc0380/2, rc 0, transno 4294967303 00000100:00100000:2.0:1788830598.690530:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2565cc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875724595165696:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1788830598.690962:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e257e924000/2, rc 0, transno 4294967301 00000100:00100000:3.0:1788830598.690969:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257e924000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875724595165568:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1788830598.692291:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788830598.692307:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000347152c2/0x575506951eea10bb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830598.692325:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2445b7ee00 already unused, calling callback (ffffffffc14cb350) 00010000:00010000:1.0:1788830598.692331:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000347152c2/0x575506951eea10bb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830598.692343:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000347152c2/0x575506951eea10bb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830598.692383:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000347152c2/0x575506951eea10bb lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830598.692392:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000347152c2/0x575506951eea10bb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830598.692418:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788830598.692420:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788830598.692422:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788830598.733880:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257ffdc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+8:2354:x1875724578366464:12345-192.168.201.21@tcp:16:lhsmtool_posix.0 Request processed in 43365us (44440us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830598.733898:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 32 00000001:00080000:3.0:1788830598.734039:0:6709:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000001:00080000:3.0:1788830598.734053:0:6709:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000100:00100000:3.0:1788830598.736928:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830598.737084:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578366720 00000100:00100000:1.0:1788830598.737097:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578366720 00000100:00100000:1.0:1788830598.737248:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 81 00000100:00100000:1.0:1788830598.737262:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25654d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+14:10441:x1875724578366720:12345-192.168.201.21@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788830598.737350:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788830598.737388:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944000/0x575506951eea10a6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661da0 expref: 14 pid: 8202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830598.737415:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9e25530b0900) 00010000:00010000:1.0:1788830598.737422:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788830598.737464:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea10c2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830598.737480:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea10c2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830598.737511:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea10c2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788830598.738218:0:5833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000047e306a7 reply state 0000000077d6ba4e transno 4294967354 ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea10c2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788830598.738232:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788830598.738387:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25654d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+15:10441:x1875724578366720:12345-192.168.201.21@tcp:36:lhsmtool_posix.0 Request processed in 1124us (1469us total) trans 4294967354 rc 0/0 00000100:00100000:1.0:1788830598.738396:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 81 00010000:00010000:3.0:1788830598.743174:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea10c2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830598.743191:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea10c2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830598.743199:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea10c2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830598.743204:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e25820ff800 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:3.0:1788830598.743209:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea10c2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830598.743216:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea10c2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830598.743233:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9e25530b0900) 00010000:00010000:3.0:1788830598.743236:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788830598.743240:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea10c2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830598.743246:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea10c2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788830598.746102:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830598.746241:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578366848 00000100:00100000:0.0:1788830598.746257:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578366848 00000100:00100000:0.0:1788830598.746405:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 33 00000100:00100000:0.0:1788830598.746418:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25654d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+6:2354:x1875724578366848:12345-192.168.201.21@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788830598.746794:0:6679:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1788830598.746799:0:6679:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1788830598 -> 1788830597 00002000:00010000:0.0:1788830598.746802:0:6679:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788830595 00002000:00010000:0.0:1788830598.746805:0:6679:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1788830598 -> 1788830597 00002000:00010000:0.0:1788830598.746807:0:6679:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1788830598.746895:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25654d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+7:2354:x1875724578366848:12345-192.168.201.21@tcp:2:lhsmtool_posix.0 Request processed in 480us (803us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1788830598.746902:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 33 00000100:00100000:2.0:1788830598.754909:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830598.755240:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578367104 00000100:00100000:0.0:1788830598.755251:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578367104 00000100:00100000:0.0:1788830598.755315:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 82 00000100:00100000:0.0:1788830598.755326:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257ffdc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+14:10441:x1875724578367104:12345-192.168.201.21@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1788830598.755398:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea10c9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830598.755429:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944a00/0x575506951eea1083 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661d92 expref: 14 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830598.755456:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea10c9 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830598.755492:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944a00/0x575506951eea1083 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.21@tcp remote: 0xa578910534661d92 expref: 14 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830598.755506:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944a00/0x575506951eea1083 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661d92 expref: 14 pid: 5832 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788830598.755521:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25747c1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5832:1875724595165824:192.168.201.21@tcp:104: 00000100:00100000:0.0:1788830598.755630:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2581e760c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788830598.759208:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25747c1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5832:1875724595165824:192.168.201.21@tcp:104: 00010000:00010000:0.0:1788830598.759243:0:5832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea10c9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788830598.760202:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830598.760337:0:11161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578367232 00000100:00100000:1.0:1788830598.760353:0:11161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578367232 00010000:00010000:1.0:1788830598.760411:0:11161:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944a00/0x575506951eea1083 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661d92 expref: 15 pid: 5832 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788830598.760473:0:11161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 43 00000100:00100000:1.0:1788830598.760485:0:11161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257ffddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+15:2354:x1875724578367232:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788830598.760503:0:11161:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788830598.760511:0:11161:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944a00/0x575506951eea1083 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661d92 expref: 15 pid: 5832 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830598.760526:0:11161:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944a00/0x575506951eea1083 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661d92 expref: 15 pid: 5832 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830598.760557:0:11161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944a00/0x575506951eea1083 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661d92 expref: 15 pid: 5832 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830598.760602:0:11161:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9e25530b0900) 00010000:00010000:1.0:1788830598.760608:0:11161:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea10c9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830598.760617:0:11161:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea10c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830598.760626:0:11161:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea10c9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830598.760659:0:11161:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788830598.760764:0:5832:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea10c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830598.760778:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea10c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788830598.760805:0:11161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257ffddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+14:2354:x1875724578367232:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 320us (604us total) trans 0 rc 0/0 00010000:00010000:0.0:1788830598.760813:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea10c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788830598.760819:0:11161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 43 00010000:00010000:0.0:1788830598.760832:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea10c9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830598.760840:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea10c9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830598.760862:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2445b7f800 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:0.0:1788830598.760868:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea10c9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830598.760876:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea10c9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830598.760893:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9e25530b0900) 00010000:00010000:0.0:1788830598.760897:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1788830598.760902:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea10c9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830598.760908:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea10c9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788830598.761411:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257ffdc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+13:10441:x1875724578367104:12345-192.168.201.21@tcp:55:lhsmtool_posix.0 Request processed in 6073us (6499us total) trans 0 rc -22/-22 00000100:00100000:0.0:1788830598.761422:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 82 00000100:00100000:2.0:1788830598.765741:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830598.765831:0:12010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578367360 00000100:00100000:0.0:1788830598.765841:0:12010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578367360 00000100:00100000:0.0:1788830598.765896:0:12010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 34 00000100:00100000:0.0:1788830598.765905:0:12010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257fbd1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+7:2355:x1875724578367360:12345-192.168.201.21@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788830598.765959:0:12010:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000347152c2/0x575506951eea10d0 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830598.765983:0:12010:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000021b17be4/0x575506951eea10b4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.21@tcp remote: 0xa578910534661dae expref: 7 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830598.766008:0:12010:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1788830598.766013:0:12010:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788830598.766017:0:12010:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000347152c2/0x575506951eea10d0 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830598.766064:0:12010:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000021b17be4/0x575506951eea10b4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.21@tcp remote: 0xa578910534661dae expref: 7 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830598.766077:0:12010:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000021b17be4/0x575506951eea10b4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.21@tcp remote: 0xa578910534661dae expref: 7 pid: 6679 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788830598.766092:0:12010:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25747c1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:12010:1875724595165952:192.168.201.21@tcp:104: 00000100:00100000:0.0:1788830598.766174:0:12010:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2581e760c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788830598.776882:0:12010:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25747c1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:12010:1875724595165952:192.168.201.21@tcp:104: 00010000:00010000:0.0:1788830598.776914:0:12010:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000347152c2/0x575506951eea10d0 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788830598.786153:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830598.786459:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578367488 00000100:00100000:3.0:1788830598.786500:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578367488 00010000:00010000:3.0:1788830598.786563:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000021b17be4/0x575506951eea10b4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.21@tcp remote: 0xa578910534661dae expref: 8 pid: 6679 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788830598.786620:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 44 00000100:00100000:3.0:1788830598.786634:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25658e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+8:2354:x1875724578367488:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788830598.786652:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788830598.786682:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000021b17be4/0x575506951eea10b4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.21@tcp remote: 0xa578910534661dae expref: 8 pid: 6679 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830598.786699:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000021b17be4/0x575506951eea10b4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.21@tcp remote: 0xa578910534661dae expref: 8 pid: 6679 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830598.786784:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000021b17be4/0x575506951eea10b4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.21@tcp remote: 0xa578910534661dae expref: 8 pid: 6679 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830598.786804:0:5817:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788830598.786810:0:5817:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788830598.786816:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000347152c2/0x575506951eea10d0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830598.786827:0:5817:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000347152c2/0x575506951eea10d0 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830598.786869:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788830598.786955:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25658e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+7:2354:x1875724578367488:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 325us (814us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830598.786975:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 44 00010000:00010000:3.0:1788830598.787135:0:12010:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000347152c2/0x575506951eea10d0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830598.787146:0:12010:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000347152c2/0x575506951eea10d0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830598.787177:0:12010:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000347152c2/0x575506951eea10d0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830598.787186:0:12010:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000347152c2/0x575506951eea10d0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830598.787195:0:12010:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000347152c2/0x575506951eea10d0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830598.787204:0:12010:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2445b7ee00 already unused, calling callback (ffffffffc14cb350) 00010000:00010000:3.0:1788830598.787210:0:12010:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000347152c2/0x575506951eea10d0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830598.787221:0:12010:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000347152c2/0x575506951eea10d0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830598.787235:0:12010:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000347152c2/0x575506951eea10d0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830598.787255:0:12010:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000347152c2/0x575506951eea10d0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788830598.787330:0:12010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257fbd1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+6:2355:x1875724578367360:12345-192.168.201.21@tcp:1:lhsmtool_posix.0 Request processed in 21424us (21629us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830598.787338:0:12010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 34 00000100:00100000:2.0:1788830598.791770:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830598.791860:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578367744 00000100:00100000:0.0:1788830598.791869:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578367744 00000100:00100000:0.0:1788830598.791918:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 83 00000100:00100000:0.0:1788830598.791926:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25658e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+13:10441:x1875724578367744:12345-192.168.201.21@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788830598.791993:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea10d7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830598.792015:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea10d7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830598.792024:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea10d7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830598.792235:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f000/0x575506951eea10de lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830598.792246:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ec00/0x575506951eea1091 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661d99 expref: 14 pid: 8202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830598.792254:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f000/0x575506951eea10de lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830598.792289:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ec00/0x575506951eea1091 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.21@tcp remote: 0xa578910534661d99 expref: 14 pid: 8202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830598.792301:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ec00/0x575506951eea1091 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661d99 expref: 14 pid: 8202 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788830598.792316:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25747c1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5834:1875724595166080:192.168.201.21@tcp:104: 00000100:00100000:0.0:1788830598.792399:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2581e760c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788830598.797653:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830598.797907:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25747c1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5834:1875724595166080:192.168.201.21@tcp:104: 00010000:00010000:0.0:1788830598.797931:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f000/0x575506951eea10de lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788830598.799311:0:11161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578367872 00000100:00100000:1.0:1788830598.799324:0:11161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578367872 00010000:00010000:0.0:1788830598.800539:0:11161:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ec00/0x575506951eea1091 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661d99 expref: 15 pid: 8202 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788830598.800606:0:11161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 45 00000100:00100000:0.0:1788830598.800626:0:11161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25658e1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+15:2354:x1875724578367872:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788830598.800642:0:11161:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788830598.800649:0:11161:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ec00/0x575506951eea1091 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661d99 expref: 15 pid: 8202 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830598.800663:0:11161:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ec00/0x575506951eea1091 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661d99 expref: 15 pid: 8202 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830598.800685:0:11161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ec00/0x575506951eea1091 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661d99 expref: 15 pid: 8202 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830598.800702:0:11161:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9e25530b0900) 00010000:00010000:0.0:1788830598.800736:0:11161:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f000/0x575506951eea10de lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830598.800746:0:11161:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f000/0x575506951eea10de lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830598.800754:0:11161:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f000/0x575506951eea10de lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830598.800788:0:11161:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788830598.800852:0:11161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25658e1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+14:2354:x1875724578367872:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 236us (3209us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830598.800859:0:11161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 45 00010000:00010000:3.0:1788830598.801989:0:5834:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f000/0x575506951eea10de lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830598.802009:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f000/0x575506951eea10de lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788830598.802297:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967355 00000001:00080000:3.0:1788830598.803901:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:3.0:1788830598.804335:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000100:00100000:3.0:1788830598.804628:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25654d1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5834:1875724595166208:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788830598.805083:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788830598.805223:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e255385d3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788830598.805490:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595166208 00000100:00100000:0.0:1788830598.805511:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595166208 00000100:00100000:0.0:1788830598.805579:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788830598.805593:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25654d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5834:x1875724595166208:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788830598.805759:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25654d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5834:x1875724595166208:12345-0@lo:1000:mdt00_002.0 Request processed in 167us (677us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830598.805767:0:5834:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000100:00100000:0.0:1788830598.805774:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000004:00080000:2.0:1788830598.805775:0:5834:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e2565cc0380, transno 4294967303 00000100:00100000:2.0:1788830598.805800:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25654d1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5834:1875724595166208:0@lo:1000:mdt00_002.0 00000001:00080000:2.0:1788830598.806253:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:2.0:1788830598.806325:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25658e2680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5834:1875724595166336:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788830598.806384:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788830598.806745:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e25483170c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788830598.808537:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595166336 00000100:00100000:3.0:1788830598.808548:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595166336 00000100:00100000:0.0:1788830598.808811:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788830598.808820:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25658e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5834:x1875724595166336:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788830598.809049:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25658e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5834:x1875724595166336:12345-0@lo:1000:mdt00_002.0 Request processed in 231us (2664us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1788830598.809065:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788830598.809154:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25658e2680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5834:1875724595166336:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1788830598.809191:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f000/0x575506951eea10de lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830598.809200:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f000/0x575506951eea10de lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830598.809205:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f000/0x575506951eea10de lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830598.809210:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2445b7f000 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:1.0:1788830598.809213:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f000/0x575506951eea10de lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830598.809233:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f000/0x575506951eea10de lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830598.809247:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9e25530b0900) 00010000:00010000:1.0:1788830598.809248:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788830598.809251:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f000/0x575506951eea10de lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830598.809256:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f000/0x575506951eea10de lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830598.809286:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e400/0x575506951eea100c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830598.809290:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e400/0x575506951eea100c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830598.809294:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e400/0x575506951eea100c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830598.809297:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2445b7e400 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:1.0:1788830598.809299:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e400/0x575506951eea100c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830598.809303:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e400/0x575506951eea100c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830598.809310:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e25518dc200) 00010000:00010000:1.0:1788830598.809312:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788830598.809315:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e400/0x575506951eea100c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830598.809331:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e400/0x575506951eea100c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830598.809352:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffe00/0x575506951eea10e5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830598.809366:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea1028 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661d7d expref: 17 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830598.809374:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffe00/0x575506951eea10e5 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830598.809412:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea1028 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.21@tcp remote: 0xa578910534661d7d expref: 17 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830598.809428:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea1028 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661d7d expref: 17 pid: 5834 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788830598.809442:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2565cc0380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5834:1875724595166464:192.168.201.21@tcp:104: 00000100:00100000:1.0:1788830598.809517:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e254747f300 going to sleep for 11 seconds 00000100:00100000:1.0:1788830598.813608:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2565cc0380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5834:1875724595166464:192.168.201.21@tcp:104: 00010000:00010000:1.0:1788830598.813651:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffe00/0x575506951eea10e5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788830598.817003:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830598.817141:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578368000 00000100:00100000:3.0:1788830598.817153:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578368000 00010000:00010000:3.0:1788830598.817194:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea1028 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661d7d expref: 18 pid: 5834 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788830598.817237:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 46 00000100:00100000:3.0:1788830598.817248:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25747c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+18:2355:x1875724578368000:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788830598.817264:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788830598.817284:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea1028 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661d7d expref: 18 pid: 5834 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830598.817310:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea1028 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661d7d expref: 18 pid: 5834 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830598.817336:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea1028 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661d7d expref: 18 pid: 5834 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830598.817352:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e25518dc200) 00010000:00010000:3.0:1788830598.817357:0:5817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffe00/0x575506951eea10e5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830598.817367:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffe00/0x575506951eea10e5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830598.817375:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffe00/0x575506951eea10e5 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830598.817407:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788830598.817470:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25747c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+17:2355:x1875724578368000:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 223us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830598.817478:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 46 00010000:00010000:1.0:1788830598.817584:0:5834:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffe00/0x575506951eea10e5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830598.817593:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffe00/0x575506951eea10e5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830598.817612:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffe00/0x575506951eea10e5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830598.817628:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffe00/0x575506951eea10e5 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830598.817635:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffe00/0x575506951eea10e5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830598.817640:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e25820ffe00 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:1.0:1788830598.817645:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffe00/0x575506951eea10e5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830598.817652:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffe00/0x575506951eea10e5 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830598.817662:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e25518dc200) 00010000:00010000:1.0:1788830598.817666:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788830598.817670:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffe00/0x575506951eea10e5 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830598.817676:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffe00/0x575506951eea10e5 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830598.817686:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea10d7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830598.817692:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea10d7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830598.817697:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea10d7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830598.817751:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2445b7f800 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:1.0:1788830598.817754:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea10d7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830598.817760:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea10d7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830598.817769:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e25518dc200) 00010000:00010000:1.0:1788830598.817772:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788830598.817775:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea10d7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830598.817781:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea10d7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788830598.817989:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25658e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+16:10441:x1875724578367744:12345-192.168.201.21@tcp:57:lhsmtool_posix.0 Request processed in 26062us (26229us total) trans 4294967359 rc 0/0 00000100:00100000:1.0:1788830598.817999:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 83 00000020:00080000:1.0:1788830598.818003:0:5834:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1788830598.818103:0:11676:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788830598.818108:0:11676:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788830598.818154:0:11676:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1788830598.818160:0:11676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788830598.823169:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830598.823247:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578368256 00000100:00100000:1.0:1788830598.823259:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578368256 00000100:00100000:1.0:1788830598.823329:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 19 00000100:00100000:1.0:1788830598.823340:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25747c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+16:10441:x1875724578368256:12345-192.168.201.21@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1788830598.824044:0:5836:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788830598.824168:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967360 00010000:00010000:1.0:1788830598.824213:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffa00/0x575506951eea10ec lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830598.824230:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffa00/0x575506951eea10ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830598.824247:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffa00/0x575506951eea10ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830598.824256:0:5836:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffa00/0x575506951eea10ec lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830598.824262:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffa00/0x575506951eea10ec lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830598.824268:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffa00/0x575506951eea10ec lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830598.824282:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788830598.824384:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25747c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+18:10441:x1875724578368256:12345-192.168.201.21@tcp:35:lhsmtool_posix.0 Request processed in 1044us (1223us total) trans 4294967361 rc 0/0 00000100:00100000:1.0:1788830598.824392:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 19 00000020:00080000:1.0:1788830598.824397:0:5836:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788830598.824737:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788830598.824744:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffa00/0x575506951eea10ec lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830598.824752:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e25820ffa00 already unused, calling callback (ffffffffc14cb350) 00010000:00010000:0.0:1788830598.824756:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffa00/0x575506951eea10ec lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830598.824764:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffa00/0x575506951eea10ec lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830598.824777:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9e257480cf00) 00010000:00010000:0.0:1788830598.824788:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788830598.824793:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffa00/0x575506951eea10ec lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830598.824798:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffa00/0x575506951eea10ec lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830598.824816:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788830598.824818:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788830598.824820:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788830599.200748:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788830600.064835:0:12048:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788830600.064844:0:12048:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788830600.064895:0:12048:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1788830600.064900:0:12048:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788830600.184820:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830600.184933:0:8202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578368384 00000100:00100000:2.0:1788830600.184944:0:8202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578368384 00000100:00100000:2.0:1788830600.185015:0:8202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 84 00000100:00100000:2.0:1788830600.185027:0:8202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2565cc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+18:10459:x1875724578368384:12345-192.168.201.21@tcp:34:lfs.0 00010000:00010000:2.0:1788830600.185127:0:8202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728e00/0x575506951eea10f3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830600.185147:0:8202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728e00/0x575506951eea10f3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830600.185162:0:8202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728e00/0x575506951eea10f3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830600.185178:0:8202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729000/0x575506951eea10fa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830600.185185:0:8202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729000/0x575506951eea10fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830600.185192:0:8202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729000/0x575506951eea10fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830600.185629:0:8202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729800/0x575506951eea1101 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830600.185639:0:8202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729800/0x575506951eea1101 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830600.185646:0:8202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729800/0x575506951eea1101 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788830600.185690:0:8202:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729800/0x575506951eea1101 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830600.185704:0:8202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728e00/0x575506951eea10f3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830600.185733:0:8202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728e00/0x575506951eea10f3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830600.185741:0:8202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728e00/0x575506951eea10f3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830600.185747:0:8202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2565728e00 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:2.0:1788830600.185752:0:8202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728e00/0x575506951eea10f3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830600.185759:0:8202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728e00/0x575506951eea10f3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830600.185771:0:8202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e25518dc500) 00010000:00010000:2.0:1788830600.185774:0:8202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788830600.185778:0:8202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728e00/0x575506951eea10f3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830600.185789:0:8202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728e00/0x575506951eea10f3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830600.185802:0:8202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729000/0x575506951eea10fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830600.185808:0:8202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729000/0x575506951eea10fa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830600.185814:0:8202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729000/0x575506951eea10fa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830600.185819:0:8202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2565729000 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:2.0:1788830600.185822:0:8202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729000/0x575506951eea10fa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830600.185828:0:8202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729000/0x575506951eea10fa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830600.185836:0:8202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9e2551f3e000) 00010000:00010000:2.0:1788830600.185839:0:8202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788830600.185842:0:8202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729000/0x575506951eea10fa lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830600.185848:0:8202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729000/0x575506951eea10fa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830600.185862:0:8202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729800/0x575506951eea1101 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830600.185868:0:8202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729800/0x575506951eea1101 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830600.185879:0:8202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729800/0x575506951eea1101 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830600.185884:0:8202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2565729800 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:2.0:1788830600.185887:0:8202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729800/0x575506951eea1101 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830600.185892:0:8202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729800/0x575506951eea1101 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830600.185900:0:8202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e2551f3e100) 00010000:00010000:2.0:1788830600.185902:0:8202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788830600.185905:0:8202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729800/0x575506951eea1101 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830600.185910:0:8202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729800/0x575506951eea1101 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788830600.185996:0:8202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2565cc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+18:10459:x1875724578368384:12345-192.168.201.21@tcp:34:lfs.0 Request processed in 970us (1187us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830600.186005:0:8202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 84 00000100:00080000:1.0:1788830600.186099:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788830600.224326:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788830600.293570:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830600.294095:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578368640 00000100:00100000:1.0:1788830600.294106:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578368640 00000100:00100000:1.0:1788830600.294172:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 85 00000100:00100000:1.0:1788830600.294183:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25654d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+18:10462:x1875724578368640:12345-192.168.201.21@tcp:101:lfs.0 00010000:00010000:1.0:1788830600.294213:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788830600.294234:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea1108 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa578910534661db5 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.295141:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea110f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.295170:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea110f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.295182:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea110f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.295198:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe800/0x575506951eea1116 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.295205:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe800/0x575506951eea1116 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.295212:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe800/0x575506951eea1116 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.295513:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffa00/0x575506951eea111d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.295523:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffa00/0x575506951eea111d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.295530:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffa00/0x575506951eea111d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788830600.295541:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:1.0:1788830600.295628:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea110f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.295636:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea110f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.295643:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea110f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.295655:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e25820ff800 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:1.0:1788830600.295660:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea110f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.295669:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea110f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.295681:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e25518dc500) 00010000:00010000:1.0:1788830600.295684:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788830600.295688:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea110f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.295694:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea110f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.295748:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe800/0x575506951eea1116 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.295755:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe800/0x575506951eea1116 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.295760:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe800/0x575506951eea1116 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.295772:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e25820fe800 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:1.0:1788830600.295775:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe800/0x575506951eea1116 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.295781:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe800/0x575506951eea1116 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.295807:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9e257480c500) 00010000:00010000:1.0:1788830600.295810:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788830600.295814:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe800/0x575506951eea1116 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.295819:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe800/0x575506951eea1116 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.295862:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea1108 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661db5 expref: 21 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.295876:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffa00/0x575506951eea111d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661db5 expref: 20 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.295883:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e257480c300) 00010000:00010000:1.0:1788830600.295885:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788830600.295888:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e25820ffa00, rc 0) 00000100:00100000:1.0:1788830600.295948:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25654d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+20:10462:x1875724578368640:12345-192.168.201.21@tcp:101:lfs.0 Request processed in 1767us (2388us total) trans 4294967362 rc 0/0 00000100:00100000:1.0:1788830600.295956:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 85 00000100:00100000:0.0:1788830600.300401:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830600.300492:0:8202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578368768 00000100:00100000:2.0:1788830600.300503:0:8202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578368768 00000100:00100000:2.0:1788830600.300606:0:8202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 86 00000100:00100000:2.0:1788830600.300618:0:8202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25747c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+20:10462:x1875724578368768:12345-192.168.201.21@tcp:54:lfs.0 00010000:00010000:2.0:1788830600.300691:0:8202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729800/0x575506951eea112b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830600.300746:0:8202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729800/0x575506951eea112b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830600.300778:0:8202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729800/0x575506951eea112b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830600.301161:0:8202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729800/0x575506951eea112b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830600.301170:0:8202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729800/0x575506951eea112b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830600.301177:0:8202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729800/0x575506951eea112b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830600.301183:0:8202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2565729800 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:2.0:1788830600.301187:0:8202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729800/0x575506951eea112b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830600.301204:0:8202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729800/0x575506951eea112b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830600.301217:0:8202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e257480c300) 00010000:00010000:2.0:1788830600.301221:0:8202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788830600.301225:0:8202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729800/0x575506951eea112b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830600.301231:0:8202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729800/0x575506951eea112b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788830600.301319:0:8202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25747c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+20:10462:x1875724578368768:12345-192.168.201.21@tcp:54:lfs.0 Request processed in 703us (928us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830600.301327:0:8202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 86 00000100:00100000:0.0:1788830600.306093:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830600.306246:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578369024 00000100:00100000:3.0:1788830600.306257:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578369024 00000100:00100000:3.0:1788830600.306330:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 20 00000100:00100000:3.0:1788830600.306340:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25747c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+20:10462:x1875724578369024:12345-192.168.201.21@tcp:35:lfs.0 00000100:00100000:3.0:1788830600.306575:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25747c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+21:10462:x1875724578369024:12345-192.168.201.21@tcp:35:lfs.0 Request processed in 235us (490us total) trans 4294967363 rc 0/0 00000100:00100000:3.0:1788830600.306583:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 20 00000100:00100000:3.0:1788830600.363941:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830600.365075:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578369280 00000100:00100000:1.0:1788830600.365085:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578369280 00000100:00100000:1.0:1788830600.365146:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 87 00000100:00100000:1.0:1788830600.365155:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25654d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+21:9982:x1875724578369280:12345-192.168.201.21@tcp:101:bash.0 00010000:00010000:1.0:1788830600.365179:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788830600.365199:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea1132 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa578910534661dbc expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.366553:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe800/0x575506951eea1139 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.366573:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffa00/0x575506951eea111d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661db5 expref: 22 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.366580:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe800/0x575506951eea1139 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.366615:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffa00/0x575506951eea111d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.21@tcp remote: 0xa578910534661db5 expref: 22 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.366626:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffa00/0x575506951eea111d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661db5 expref: 22 pid: 5833 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788830600.366637:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2565cc2680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5833:1875724595166592:192.168.201.21@tcp:104: 00000100:00100000:1.0:1788830600.366734:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2545c71000 going to sleep for 11 seconds 00000100:00100000:0.0:1788830600.379750:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830600.379773:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2565cc2680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5833:1875724595166592:192.168.201.21@tcp:104: 00000100:00100000:2.0:1788830600.379844:0:11161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578369408 00000100:00100000:2.0:1788830600.379862:0:11161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578369408 00010000:00010000:1.0:1788830600.379866:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe800/0x575506951eea1139 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830600.379901:0:11161:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffa00/0x575506951eea111d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661db5 expref: 23 pid: 5833 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788830600.379935:0:11161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 47 00000100:00100000:2.0:1788830600.379941:0:11161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25747c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+23:2355:x1875724578369408:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788830600.379952:0:11161:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788830600.379957:0:11161:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffa00/0x575506951eea111d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661db5 expref: 23 pid: 5833 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830600.379966:0:11161:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffa00/0x575506951eea111d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661db5 expref: 23 pid: 5833 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830600.379982:0:11161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffa00/0x575506951eea111d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661db5 expref: 23 pid: 5833 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830600.379994:0:11161:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e257480c300) 00010000:00010000:2.0:1788830600.379997:0:11161:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe800/0x575506951eea1139 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830600.380003:0:11161:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe800/0x575506951eea1139 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830600.380008:0:11161:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe800/0x575506951eea1139 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830600.380024:0:11161:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788830600.380062:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe800/0x575506951eea1139 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.380070:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe800/0x575506951eea1139 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788830600.380086:0:11161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25747c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+22:2355:x1875724578369408:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 143us (377us total) trans 0 rc 0/0 00000004:00200000:1.0:1788830600.380091:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00000100:00100000:2.0:1788830600.380105:0:11161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 47 00010000:00010000:1.0:1788830600.381786:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea1132 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661dbc expref: 23 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.381823:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe800/0x575506951eea1139 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661dbc expref: 22 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.381832:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e257480c300) 00010000:00010000:1.0:1788830600.381835:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788830600.381837:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e25820fe800, rc 0) 00000100:00100000:1.0:1788830600.381900:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25654d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+22:9982:x1875724578369280:12345-192.168.201.21@tcp:101:bash.0 Request processed in 16745us (17967us total) trans 4294967364 rc 0/0 00000100:00100000:1.0:1788830600.381908:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 87 00000100:00100000:0.0:1788830600.385128:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830600.386298:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578369664 00000100:00100000:1.0:1788830600.386312:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578369664 00000100:00100000:1.0:1788830600.386374:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 88 00000100:00100000:1.0:1788830600.386384:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257f726300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+22:9982:x1875724578369664:12345-192.168.201.21@tcp:36:bash.0 00010000:00010000:1.0:1788830600.386611:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea1147 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.386625:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea1147 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.386636:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea1147 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788830600.386687:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967365 00000004:00010000:1.0:1788830600.386731:0:5832:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000045a49392 reply state 0000000013960bf5 transno 4294967366 ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea1147 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788830600.386740:0:5832:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1788830600.386804:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967366 00000100:00100000:1.0:1788830600.386918:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257f726300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+26:9982:x1875724578369664:12345-192.168.201.21@tcp:36:bash.0 Request processed in 535us (1799us total) trans 4294967367 rc 0/0 00000100:00100000:1.0:1788830600.386926:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 88 00000020:00080000:1.0:1788830600.386930:0:5832:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:3.0:1788830600.391455:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea1147 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830600.391474:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea1147 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830600.391482:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea1147 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830600.391489:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e25820ff800 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:3.0:1788830600.391494:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea1147 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830600.391502:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea1147 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830600.391519:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e257480c300) 00010000:00010000:3.0:1788830600.391523:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788830600.391527:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea1147 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830600.391534:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea1147 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788830600.392927:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830600.393638:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578369792 00000100:00100000:2.0:1788830600.393649:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578369792 00000100:00100000:2.0:1788830600.393763:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 89 00000100:00100000:2.0:1788830600.393777:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257f724000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+25:9982:x1875724578369792:12345-192.168.201.21@tcp:101:bash.0 00010000:00010000:2.0:1788830600.393801:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788830600.393820:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729800/0x575506951eea114e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa578910534661dc3 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830600.393880:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729800/0x575506951eea114e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661dc3 expref: 26 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830600.393891:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729800/0x575506951eea114e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661dc3 expref: 26 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830600.393923:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e257480c300) 00010000:00010000:2.0:1788830600.393927:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788830600.393930:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2565729800, rc 0) 00000100:00100000:2.0:1788830600.393989:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257f724000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+26:9982:x1875724578369792:12345-192.168.201.21@tcp:101:bash.0 Request processed in 216us (1071us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830600.394141:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 89 00000100:00100000:0.0:1788830600.397274:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830600.397356:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578369920 00000100:00100000:3.0:1788830600.397377:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578369920 00000100:00100000:3.0:1788830600.397438:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 35 00000100:00100000:3.0:1788830600.397448:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2551308380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+6:9982:x1875724578369920:12345-192.168.201.21@tcp:101:bash.0 00010000:00010000:3.0:1788830600.397465:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788830600.397485:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000037589048/0x575506951eea1155 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa578910534661dca expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788830600.397513:0:6680:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a9f6385, atime: 0x6a9f6383, ctime: 0x6a9f6385, blocks: 0xb 00010000:00010000:3.0:1788830600.397534:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=353s v=(0 0) 00010000:00010000:3.0:1788830600.397539:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788830600.397547:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000037589048/0x575506951eea1155 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.21@tcp remote: 0xa578910534661dca expref: 7 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830600.397565:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000037589048/0x575506951eea1155 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.21@tcp remote: 0xa578910534661dca expref: 7 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830600.397578:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e257d945200, rc 0) 00000100:00100000:3.0:1788830600.397817:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2551308380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+7:9982:x1875724578369920:12345-192.168.201.21@tcp:101:bash.0 Request processed in 368us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830600.397825:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 35 00000100:00100000:0.0:1788830600.400193:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830600.400355:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578370048 00000100:00100000:2.0:1788830600.400362:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578370048 00002000:00010000:2.0:1788830600.400393:0:6683:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:2.0:1788830600.400397:0:6683:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e255130a300 with x1875724578370048 ext(0->18446744073709551615) 00002000:00010000:2.0:1788830600.400406:0:6683:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e255130a300. 00000100:00100000:2.0:1788830600.400431:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 1 00000100:00100000:2.0:1788830600.400454:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255130a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+7:2354:x1875724578370048:12345-192.168.201.21@tcp:10:bash.0 00002000:00010000:2.0:1788830600.400701:0:6683:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1788830600.400704:0:6683:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1788830597 -> 1788830600 00002000:00010000:2.0:1788830600.400705:0:6683:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 1788830595 -> 1788830595 00002000:00010000:2.0:1788830600.400740:0:6683:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1788830597 -> 1788830600 00002000:00010000:2.0:1788830600.400743:0:6683:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1788830600.400793:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255130a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+8:2354:x1875724578370048:12345-192.168.201.21@tcp:10:bash.0 Request processed in 340us (616us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1788830600.400800:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 1 00002000:00010000:2.0:1788830600.400804:0:6683:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:2.0:1788830600.400807:0:6683:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e255130a300 with x1875724578370048 ext(0->18446744073709551615) 00002000:00010000:2.0:1788830600.400812:0:6683:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e255130a300. 00000100:00080000:1.0:1788830600.401087:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788830600.467086:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830600.467278:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578370176 00000100:00100000:1.0:1788830600.467288:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578370176 00000100:00100000:1.0:1788830600.467405:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 90 00000100:00100000:1.0:1788830600.467417:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255130aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+26:10476:x1875724578370176:12345-192.168.201.21@tcp:34:lfs.0 00010000:00010000:1.0:1788830600.467621:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea115c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.467641:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea115c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.467653:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea115c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.467670:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffe00/0x575506951eea1163 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.467677:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffe00/0x575506951eea1163 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.467684:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffe00/0x575506951eea1163 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.467977:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff400/0x575506951eea116a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.467987:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff400/0x575506951eea116a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.468003:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff400/0x575506951eea116a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788830600.468058:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff400/0x575506951eea116a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.468071:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea115c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.468077:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea115c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.468085:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea115c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.468090:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e25820fe400 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:1.0:1788830600.468240:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea115c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.468249:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea115c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.468261:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e25518dc500) 00010000:00010000:1.0:1788830600.468264:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788830600.468268:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea115c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.468275:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea115c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.468288:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffe00/0x575506951eea1163 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.468301:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffe00/0x575506951eea1163 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.468306:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffe00/0x575506951eea1163 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.468310:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e25820ffe00 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:1.0:1788830600.468313:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffe00/0x575506951eea1163 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.468319:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffe00/0x575506951eea1163 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.468327:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9e257480c500) 00010000:00010000:1.0:1788830600.468329:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788830600.468332:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffe00/0x575506951eea1163 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.468338:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffe00/0x575506951eea1163 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.468354:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff400/0x575506951eea116a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.468360:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff400/0x575506951eea116a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.468366:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff400/0x575506951eea116a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.468371:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e25820ff400 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:1.0:1788830600.468380:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff400/0x575506951eea116a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.468386:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff400/0x575506951eea116a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.468395:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e257480c300) 00010000:00010000:1.0:1788830600.468397:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788830600.468400:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff400/0x575506951eea116a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.468406:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff400/0x575506951eea116a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788830600.468906:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255130aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+26:10476:x1875724578370176:12345-192.168.201.21@tcp:34:lfs.0 Request processed in 1477us (1816us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830600.468916:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 90 00000100:00100000:0.0:1788830600.525188:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830600.525278:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578370432 00000100:00100000:1.0:1788830600.525287:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578370432 00000100:00100000:1.0:1788830600.525440:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 91 00000100:00100000:1.0:1788830600.525450:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255130b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+26:10479:x1875724578370432:12345-192.168.201.21@tcp:101:lfs.0 00010000:00010000:1.0:1788830600.525469:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788830600.525497:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff400/0x575506951eea1171 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa578910534661dd1 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.525574:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffe00/0x575506951eea1178 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.525588:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffe00/0x575506951eea1178 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.525615:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffe00/0x575506951eea1178 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.525629:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea117f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.525636:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea117f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.525642:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea117f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.525908:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea1186 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.525917:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea1186 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.525924:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea1186 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788830600.525933:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1788830600.526012:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffe00/0x575506951eea1178 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.526019:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffe00/0x575506951eea1178 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.526038:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffe00/0x575506951eea1178 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.526045:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e25820ffe00 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:1.0:1788830600.526055:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffe00/0x575506951eea1178 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.526062:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffe00/0x575506951eea1178 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.526073:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e25518dc500) 00010000:00010000:1.0:1788830600.526076:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788830600.526080:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffe00/0x575506951eea1178 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.526086:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffe00/0x575506951eea1178 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.526099:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea117f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.526105:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea117f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.526110:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea117f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.526115:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e25820fe400 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:1.0:1788830600.526118:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea117f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.526124:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea117f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.526130:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9e257480c500) 00010000:00010000:1.0:1788830600.526132:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788830600.526141:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea117f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.526147:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea117f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.526186:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff400/0x575506951eea1171 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661dd1 expref: 29 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.526199:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea1186 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661dd1 expref: 28 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.526206:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e257480c300) 00010000:00010000:1.0:1788830600.526208:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788830600.526211:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e25820ff800, rc 0) 00000100:00100000:1.0:1788830600.526264:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255130b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+28:10479:x1875724578370432:12345-192.168.201.21@tcp:101:lfs.0 Request processed in 815us (1085us total) trans 4294967368 rc 0/0 00000100:00100000:1.0:1788830600.526271:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 91 00000100:00100000:0.0:1788830600.536646:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830600.536861:0:8202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578370560 00000100:00100000:3.0:1788830600.536879:0:8202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578370560 00000100:00100000:3.0:1788830600.536972:0:8202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 92 00000100:00100000:3.0:1788830600.536988:0:8202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2551308a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+28:10479:x1875724578370560:12345-192.168.201.21@tcp:54:lfs.0 00010000:00010000:3.0:1788830600.537094:0:8202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944200/0x575506951eea1194 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830600.537149:0:8202:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe800/0x575506951eea1139 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661dbc expref: 28 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830600.537161:0:8202:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944200/0x575506951eea1194 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830600.537209:0:8202:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe800/0x575506951eea1139 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.21@tcp remote: 0xa578910534661dbc expref: 28 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830600.537225:0:8202:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe800/0x575506951eea1139 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661dbc expref: 28 pid: 5833 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788830600.537242:0:8202:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25654d2680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8202:1875724595166720:192.168.201.21@tcp:104: 00000100:00100000:3.0:1788830600.537366:0:8202:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e255385d000 going to sleep for 11 seconds 00000100:00100000:0.0:1788830600.552200:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830600.552335:0:8202:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25654d2680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8202:1875724595166720:192.168.201.21@tcp:104: 00010000:00010000:3.0:1788830600.552374:0:8202:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944200/0x575506951eea1194 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788830600.552522:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578370816 00000100:00100000:1.0:1788830600.552531:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578370816 00000100:00100000:1.0:1788830600.552614:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 21 00000100:00100000:1.0:1788830600.552627:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25629b3050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+29:5589:x1875724578370816:12345-192.168.201.21@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788830600.553133:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25629b3050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+30:5589:x1875724578370816:12345-192.168.201.21@tcp:35:ldlm_bl.0 Request processed in 507us (946us total) trans 4294967369 rc 0/0 00000100:00100000:1.0:1788830600.553142:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 21 00000100:00100000:0.0:1788830600.557690:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830600.557974:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578370944 00000100:00100000:3.0:1788830600.557989:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578370944 00010000:00010000:3.0:1788830600.558054:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe800/0x575506951eea1139 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661dbc expref: 30 pid: 5833 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788830600.558106:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 48 00000100:00100000:3.0:1788830600.558118:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2551309f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+30:2354:x1875724578370944:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788830600.558139:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788830600.558165:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe800/0x575506951eea1139 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661dbc expref: 30 pid: 5833 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830600.558180:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe800/0x575506951eea1139 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661dbc expref: 30 pid: 5833 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830600.558209:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe800/0x575506951eea1139 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661dbc expref: 30 pid: 5833 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830600.558230:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e257480c300) 00010000:00010000:3.0:1788830600.558236:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944200/0x575506951eea1194 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830600.558247:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944200/0x575506951eea1194 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830600.558256:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944200/0x575506951eea1194 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830600.558298:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788830600.558370:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2551309f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+29:2354:x1875724578370944:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 253us (694us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830600.558378:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 48 00010000:00010000:0.0:1788830600.559334:0:8202:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944200/0x575506951eea1194 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830600.559347:0:8202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944200/0x575506951eea1194 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830600.559390:0:8202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944200/0x575506951eea1194 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830600.559416:0:8202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944200/0x575506951eea1194 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830600.559423:0:8202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944200/0x575506951eea1194 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830600.559430:0:8202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e257d944200 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:0.0:1788830600.559435:0:8202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944200/0x575506951eea1194 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830600.559445:0:8202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944200/0x575506951eea1194 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830600.559460:0:8202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e257480c300) 00010000:00010000:0.0:1788830600.559463:0:8202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788830600.559467:0:8202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944200/0x575506951eea1194 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830600.559474:0:8202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944200/0x575506951eea1194 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788830600.559556:0:8202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2551308a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+28:10479:x1875724578370560:12345-192.168.201.21@tcp:54:lfs.0 Request processed in 22570us (22918us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830600.559565:0:8202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 92 00000100:00100000:0.0:1788830600.562139:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830600.562174:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578371200 00000100:00100000:1.0:1788830600.562184:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578371200 00000100:00100000:1.0:1788830600.562239:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 22 00000100:00100000:1.0:1788830600.562249:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255130ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+28:10479:x1875724578371200:12345-192.168.201.21@tcp:35:lfs.0 00000100:00100000:1.0:1788830600.562888:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255130ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+29:10479:x1875724578371200:12345-192.168.201.21@tcp:35:lfs.0 Request processed in 638us (758us total) trans 4294967370 rc 0/0 00000100:00100000:1.0:1788830600.562897:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 22 00000100:00100000:3.0:1788830600.656923:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830600.657052:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578371456 00000100:00100000:2.0:1788830600.657070:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578371456 00000100:00100000:2.0:1788830600.657163:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 93 00000100:00100000:2.0:1788830600.657177:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25654d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+29:10490:x1875724578371456:12345-192.168.201.21@tcp:101:cat.0 00010000:00010000:2.0:1788830600.657209:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788830600.657239:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729000/0x575506951eea119b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa578910534661dd8 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830600.657356:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728e00/0x575506951eea11a2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830600.657376:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728e00/0x575506951eea11a2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830600.657393:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728e00/0x575506951eea11a2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830600.657430:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729a00/0x575506951eea11a9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830600.657437:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729a00/0x575506951eea11a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830600.657444:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729a00/0x575506951eea11a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830600.658624:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945c00/0x575506951eea11b0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830600.658644:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945c00/0x575506951eea11b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830600.658656:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945c00/0x575506951eea11b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788830600.658681:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:3.0:1788830600.658816:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728e00/0x575506951eea11a2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830600.658823:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728e00/0x575506951eea11a2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830600.658828:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728e00/0x575506951eea11a2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830600.658832:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2565728e00 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:3.0:1788830600.658837:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728e00/0x575506951eea11a2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830600.658846:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728e00/0x575506951eea11a2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830600.658861:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e25518dc500) 00010000:00010000:3.0:1788830600.658864:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788830600.658870:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728e00/0x575506951eea11a2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830600.658876:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728e00/0x575506951eea11a2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830600.658892:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729a00/0x575506951eea11a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830600.658898:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729a00/0x575506951eea11a9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830600.658915:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729a00/0x575506951eea11a9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830600.658920:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2565729a00 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:3.0:1788830600.658923:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729a00/0x575506951eea11a9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830600.658929:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729a00/0x575506951eea11a9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830600.658937:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9e2551f3e100) 00010000:00010000:3.0:1788830600.658939:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788830600.658943:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729a00/0x575506951eea11a9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830600.658949:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729a00/0x575506951eea11a9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830600.659010:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729000/0x575506951eea119b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661dd8 expref: 32 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830600.659038:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945c00/0x575506951eea11b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661dd8 expref: 31 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830600.659046:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e257480c300) 00010000:00010000:3.0:1788830600.659049:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788830600.659051:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e257d945c00, rc 0) 00000100:00100000:3.0:1788830600.659219:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25654d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+31:10490:x1875724578371456:12345-192.168.201.21@tcp:101:cat.0 Request processed in 2043us (2303us total) trans 4294967371 rc 0/0 00000100:00100000:3.0:1788830600.659238:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 93 00000100:00100000:0.0:1788830600.671484:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830600.671585:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578371712 00000100:00100000:1.0:1788830600.671594:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578371712 00000100:00100000:1.0:1788830600.671647:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 23 00000100:00100000:1.0:1788830600.671655:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255005ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+31:10490:x1875724578371712:12345-192.168.201.21@tcp:35:cat.0 00000100:00100000:1.0:1788830600.672092:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255005ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+32:10490:x1875724578371712:12345-192.168.201.21@tcp:35:cat.0 Request processed in 436us (615us total) trans 4294967372 rc 0/0 00000100:00100000:1.0:1788830600.672097:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 23 00000100:00100000:0.0:1788830600.698162:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830600.698342:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578371968 00000100:00100000:1.0:1788830600.698352:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578371968 00000100:00100000:1.0:1788830600.698413:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 94 00000100:00100000:1.0:1788830600.698425:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255005e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+32:10491:x1875724578371968:12345-192.168.201.21@tcp:36:rm.0 00010000:00010000:1.0:1788830600.698487:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788830600.698515:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945c00/0x575506951eea11b0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661dd8 expref: 32 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.698539:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea1186 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661dd1 expref: 31 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.698554:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729800/0x575506951eea114e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661dc3 expref: 30 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.698566:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e257480c300) 00010000:00010000:1.0:1788830600.698578:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788830600.698612:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea11be lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.698625:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea11be lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.698644:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea11be lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.698659:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffe00/0x575506951eea11c5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.698666:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffe00/0x575506951eea11c5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.698674:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffe00/0x575506951eea11c5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.699075:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffa00/0x575506951eea11cc lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.699085:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffa00/0x575506951eea11cc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.699092:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffa00/0x575506951eea11cc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788830600.699985:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:1.0:1788830600.699996:0:5832:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 354047285785ns, next at 355047283000ns, rc = 0 00010000:00010000:1.0:1788830600.700065:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe800/0x575506951eea11d3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.700075:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe800/0x575506951eea11d3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.700089:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe800/0x575506951eea11d3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.700096:0:5832:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe800/0x575506951eea11d3 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.700102:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe800/0x575506951eea11d3 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.700166:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe800/0x575506951eea11d3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.700193:0:5832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788830600.700284:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffa00/0x575506951eea11cc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.700292:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffa00/0x575506951eea11cc lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.700298:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffa00/0x575506951eea11cc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.700304:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e25820ffa00 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:1.0:1788830600.700308:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffa00/0x575506951eea11cc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.700316:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffa00/0x575506951eea11cc lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.700328:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e257480cf00) 00010000:00010000:1.0:1788830600.700331:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788830600.700342:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffa00/0x575506951eea11cc lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.700349:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffa00/0x575506951eea11cc lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.700366:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea11be lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.700372:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea11be lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.700377:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea11be lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.700381:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e25820fe400 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:1.0:1788830600.700384:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea11be lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.700389:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea11be lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.700397:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e25518dc500) 00010000:00010000:1.0:1788830600.700399:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788830600.700401:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea11be lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.700406:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea11be lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788830600.700415:0:5832:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008e9bb770 reply state 0000000071c16983 transno 4294967373 ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffe00/0x575506951eea11c5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788830600.700436:0:5832:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788830600.700579:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255005e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+31:10491:x1875724578371968:12345-192.168.201.21@tcp:36:rm.0 Request processed in 2152us (2424us total) trans 4294967373 rc 0/0 00000100:00100000:1.0:1788830600.700587:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 94 00010000:00010000:3.0:1788830600.700783:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788830600.700790:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe800/0x575506951eea11d3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830600.700796:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e25820fe800 already unused, calling callback (ffffffffc14cb350) 00010000:00010000:3.0:1788830600.700800:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe800/0x575506951eea11d3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830600.700807:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe800/0x575506951eea11d3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830600.700816:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e257480cf00) 00010000:00010000:3.0:1788830600.700818:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788830600.700821:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe800/0x575506951eea11d3 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830600.700826:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe800/0x575506951eea11d3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830600.700852:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788830600.700854:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788830600.700855:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788830600.704091:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffe00/0x575506951eea11c5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830600.704127:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffe00/0x575506951eea11c5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830600.704132:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffe00/0x575506951eea11c5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830600.704136:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e25820ffe00 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:0.0:1788830600.704140:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffe00/0x575506951eea11c5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830600.704145:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffe00/0x575506951eea11c5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830600.704159:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9e257480c500) 00010000:00010000:0.0:1788830600.704161:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788830600.704164:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffe00/0x575506951eea11c5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830600.704168:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffe00/0x575506951eea11c5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788830600.734680:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830600.734990:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578372224 00000100:00100000:1.0:1788830600.735001:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578372224 00000100:00100000:1.0:1788830600.735075:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 95 00000100:00100000:1.0:1788830600.735092:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255005f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+30:10497:x1875724578372224:12345-192.168.201.21@tcp:101:bash.0 00010000:00010000:1.0:1788830600.735132:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788830600.735155:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea11da lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa578910534661ddf expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.735299:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffa00/0x575506951eea11e1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.735315:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffa00/0x575506951eea11e1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.735327:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffa00/0x575506951eea11e1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.735341:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea11e8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.735348:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea11e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.735354:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea11e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788830600.736303:0:5833:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:1.0:1788830600.736466:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff400/0x575506951eea11ef lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.736478:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff400/0x575506951eea11ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.736487:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff400/0x575506951eea11ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.736517:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffa00/0x575506951eea11e1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.736524:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffa00/0x575506951eea11e1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.736532:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffa00/0x575506951eea11e1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.736537:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e25820ffa00 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:1.0:1788830600.736542:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffa00/0x575506951eea11e1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.736549:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffa00/0x575506951eea11e1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.736560:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e25518dc500) 00010000:00010000:1.0:1788830600.736563:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788830600.736567:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffa00/0x575506951eea11e1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.736582:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffa00/0x575506951eea11e1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788830600.736598:0:5833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000099fde2e1 reply state 0000000000655aa6 transno 4294967374 ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea11e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788830600.736607:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788830600.737902:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea11da lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661ddf expref: 33 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.737938:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff400/0x575506951eea11ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661ddf expref: 32 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.737949:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e257480ce00) 00010000:00010000:1.0:1788830600.737952:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788830600.737955:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e25820ff400, rc 0) 00000100:00100000:1.0:1788830600.738051:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255005f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+33:10497:x1875724578372224:12345-192.168.201.21@tcp:101:bash.0 Request processed in 2964us (3381us total) trans 4294967374 rc 0/0 00000100:00100000:1.0:1788830600.738060:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 95 00010000:00010000:1.0:1788830600.742635:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea11e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.742660:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea11e8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.742669:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea11e8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.742677:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e25820ff800 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:1.0:1788830600.742706:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea11e8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.742766:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea11e8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.742790:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9e257480c300) 00010000:00010000:1.0:1788830600.742795:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788830600.742801:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea11e8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.742809:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea11e8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788830600.746935:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830600.747079:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578372352 00000100:00100000:1.0:1788830600.747095:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578372352 00000100:00100000:1.0:1788830600.747195:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 36 00000100:00100000:1.0:1788830600.747209:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255005f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+5:2355:x1875724578372352:12345-192.168.201.21@tcp:101:bash.0 00010000:00010000:1.0:1788830600.747235:0:6677:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788830600.747262:0:6677:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ab0a9838/0x575506951eea11fd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa578910534661de6 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788830600.747299:0:6677:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788830600.747325:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=354s v=(0 0) 00010000:00010000:1.0:1788830600.747331:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788830600.747343:0:6677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ab0a9838/0x575506951eea11fd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661de6 expref: 6 pid: 6677 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.747367:0:6677:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ab0a9838/0x575506951eea11fd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661de6 expref: 6 pid: 6677 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.747405:0:6677:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e25820fe400, rc 0) 00000100:00080000:0.0:1788830600.747569:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788830600.747680:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255005f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+6:2355:x1875724578372352:12345-192.168.201.21@tcp:101:bash.0 Request processed in 473us (751us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830600.747690:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 36 00000100:00100000:3.0:1788830600.750083:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830600.750440:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578372480 00000100:00100000:0.0:1788830600.750456:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578372480 00000100:00100000:0.0:1788830600.750568:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 37 00000100:00100000:0.0:1788830600.750580:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25654d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+6:10497:x1875724578372480:12345-192.168.201.21@tcp:101:bash.0 00010000:00010000:0.0:1788830600.750604:0:6679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788830600.750642:0:6679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000225edf3/0x575506951eea1204 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa578910534661ded expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830600.750682:0:6679:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ab0a9838/0x575506951eea11fd lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661de6 expref: 7 pid: 6677 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830600.750692:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788830600.750697:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788830600.750703:0:6679:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000225edf3/0x575506951eea1204 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661ded expref: 7 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830600.750796:0:6679:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ab0a9838/0x575506951eea11fd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.21@tcp remote: 0xa578910534661de6 expref: 7 pid: 6677 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830600.750812:0:6679:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ab0a9838/0x575506951eea11fd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661de6 expref: 7 pid: 6677 timeout: 454 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788830600.750832:0:6679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2566011500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6679:1875724595166848:192.168.201.21@tcp:104: 00000100:00100000:0.0:1788830600.750974:0:6679:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2541254300 going to sleep for 11 seconds 00000100:00100000:0.0:1788830600.753177:0:6679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2566011500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6679:1875724595166848:192.168.201.21@tcp:104: 00010000:00010000:0.0:1788830600.753219:0:6679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000225edf3/0x575506951eea1204 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.21@tcp remote: 0xa578910534661ded expref: 7 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830600.753247:0:6679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2445b7ec00, rc 0) 00000100:00100000:0.0:1788830600.753313:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25654d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+7:10497:x1875724578372480:12345-192.168.201.21@tcp:101:bash.0 Request processed in 2734us (3245us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830600.753342:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 37 00000100:00100000:1.0:1788830600.754071:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830600.754186:0:11161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578372608 00000100:00100000:2.0:1788830600.754197:0:11161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578372608 00010000:00010000:2.0:1788830600.754239:0:11161:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ab0a9838/0x575506951eea11fd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661de6 expref: 7 pid: 6677 timeout: 454 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788830600.754278:0:11161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 49 00000100:00100000:2.0:1788830600.754288:0:11161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2547436c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+7:2354:x1875724578372608:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788830600.754303:0:11161:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788830600.754329:0:11161:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ab0a9838/0x575506951eea11fd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661de6 expref: 7 pid: 6677 timeout: 454 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830600.754344:0:11161:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ab0a9838/0x575506951eea11fd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661de6 expref: 7 pid: 6677 timeout: 454 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830600.754372:0:11161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ab0a9838/0x575506951eea11fd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661de6 expref: 7 pid: 6677 timeout: 454 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830600.754389:0:11161:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788830600.754403:0:11161:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788830600.754413:0:11161:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000225edf3/0x575506951eea1204 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.21@tcp remote: 0xa578910534661ded expref: 6 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830600.754425:0:11161:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000225edf3/0x575506951eea1204 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.21@tcp remote: 0xa578910534661ded expref: 6 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830600.754469:0:11161:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000000225edf3/0x575506951eea1204 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.21@tcp remote: 0xa578910534661ded expref: 6 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788830600.754484:0:11161:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25658e1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11161:1875724595166976:192.168.201.21@tcp:105: 00000100:00100000:2.0:1788830600.754577:0:11161:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2548317300 going to sleep for 11 seconds 00000100:00100000:2.0:1788830600.757888:0:11161:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25658e1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11161:1875724595166976:192.168.201.21@tcp:105: 00010000:00010000:2.0:1788830600.757931:0:11161:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788830600.758059:0:11161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2547436c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+6:2354:x1875724578372608:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 3770us (3990us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830600.758071:0:11161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 49 00000100:00100000:3.0:1788830600.759563:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830600.759691:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578372864 00000100:00100000:1.0:1788830600.759836:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578372864 00000100:00100000:1.0:1788830600.759942:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 24 00000100:00100000:1.0:1788830600.759954:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25654d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+32:10497:x1875724578372864:12345-192.168.201.21@tcp:35:bash.0 00000100:00100000:1.0:1788830600.760473:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25654d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+33:10497:x1875724578372864:12345-192.168.201.21@tcp:35:bash.0 Request processed in 517us (918us total) trans 4294967375 rc 0/0 00000100:00100000:1.0:1788830600.760482:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 24 00000040:00080000:0.0:1788830600.860227:0:11676:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788830600.860243:0:11676:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788830600.860281:0:11676:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1788830600.860289:0:11676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788830600.923153:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830600.923304:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578372992 00000100:00100000:0.0:1788830600.923537:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578372992 00000100:00100000:0.0:1788830600.923664:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 96 00000100:00100000:0.0:1788830600.923676:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2565cc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+33:10513:x1875724578372992:12345-192.168.201.21@tcp:101:lfs.0 00010000:00010000:0.0:1788830600.923752:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788830600.923779:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea120b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa578910534661df4 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830600.923866:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e200/0x575506951eea1212 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830600.923882:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e200/0x575506951eea1212 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830600.923897:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e200/0x575506951eea1212 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788830600.923941:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1788830600.923945:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788830600.923967:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e200/0x575506951eea1212 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830600.923996:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea120b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661df4 expref: 35 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830600.924055:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e200/0x575506951eea1212 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661df4 expref: 34 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830600.924065:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e25518dc500) 00010000:00010000:0.0:1788830600.924069:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788830600.924073:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2445b7e200, rc 0) 00000100:00100000:0.0:1788830600.924254:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2565cc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+34:10513:x1875724578372992:12345-192.168.201.21@tcp:101:lfs.0 Request processed in 579us (1116us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830600.924262:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 96 00000100:00100000:3.0:1788830600.930372:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830600.930513:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578373248 00000100:00100000:1.0:1788830600.930527:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578373248 00000100:00100000:1.0:1788830600.930609:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 97 00000100:00100000:1.0:1788830600.930621:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25654d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+34:10513:x1875724578373248:12345-192.168.201.21@tcp:101:lfs.0 00010000:00010000:1.0:1788830600.930648:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788830600.930677:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea1219 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa578910534661dfb expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.930860:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea1220 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.930877:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea1220 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.930909:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea1220 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788830600.930923:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1788830600.931101:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea1219 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661dfb expref: 37 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.931120:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea1220 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661dfb expref: 36 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.931127:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e257480ce00) 00010000:00010000:1.0:1788830600.931130:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788830600.931133:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e25820ff800, rc 0) 00000100:00100000:1.0:1788830600.931203:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25654d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+36:10513:x1875724578373248:12345-192.168.201.21@tcp:101:lfs.0 Request processed in 585us (849us total) trans 4294967376 rc 0/0 00000100:00100000:1.0:1788830600.931210:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 97 00000100:00100000:3.0:1788830600.934702:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830600.934798:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830600.934917:0:8202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578373504 00000100:00100000:0.0:1788830600.934930:0:8202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578373504 00000100:00100000:0.0:1788830600.935010:0:8202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 98 00000100:00100000:0.0:1788830600.935033:0:8202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25654d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+36:10513:x1875724578373504:12345-192.168.201.21@tcp:101:lfs.0 00010000:00010000:0.0:1788830600.935065:0:8202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1788830600.935081:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578373632 00000100:00100000:1.0:1788830600.935086:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578373632 00010000:00010000:0.0:1788830600.935092:0:8202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea122e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa578910534661e02 expref: -99 pid: 8202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788830600.935136:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 6 00000100:00100000:1.0:1788830600.935144:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25654d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+38:2352:x1875724578373632:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788830600.935154:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788830600.935178:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea1220 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661dfb expref: 38 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.935199:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e257480ce00) 00010000:00010000:1.0:1788830600.935204:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788830600.935226:0:8202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e400/0x575506951eea1235 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830600.935242:0:8202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e400/0x575506951eea1235 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830600.935253:0:8202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e400/0x575506951eea1235 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788830600.935265:0:8202:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00000100:00100000:1.0:1788830600.935286:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25654d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+37:2352:x1875724578373632:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 143us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830600.935293:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 6 00010000:00010000:0.0:1788830600.935434:0:8202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea122e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661e02 expref: 38 pid: 8202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830600.935450:0:8202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e400/0x575506951eea1235 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661e02 expref: 37 pid: 8202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830600.935459:0:8202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e257480ce00) 00010000:00010000:0.0:1788830600.935462:0:8202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788830600.935464:0:8202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2445b7e400, rc 0) 00000100:00100000:0.0:1788830600.935488:0:8202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25654d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+37:10513:x1875724578373504:12345-192.168.201.21@tcp:101:lfs.0 Request processed in 460us (803us total) trans 4294967377 rc 0/0 00000100:00100000:0.0:1788830600.935493:0:8202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 98 00000100:00100000:2.0:1788830600.941227:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830600.941336:0:12010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578373760 00000100:00100000:3.0:1788830600.941349:0:12010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578373760 00000100:00100000:3.0:1788830600.941445:0:12010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 38 00000100:00100000:3.0:1788830600.941458:0:12010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25658e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+6:2354:x1875724578373760:12345-192.168.201.21@tcp:1:lfs.0 00010000:00010000:3.0:1788830600.941521:0:12010:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000073305c70/0x575506951eea1243 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830600.941548:0:12010:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000225edf3/0x575506951eea1204 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.21@tcp remote: 0xa578910534661ded expref: 6 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830600.941559:0:12010:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788830600.941564:0:12010:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788830600.941570:0:12010:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000073305c70/0x575506951eea1243 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830600.941623:0:12010:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000225edf3/0x575506951eea1204 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.21@tcp remote: 0xa578910534661ded expref: 6 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830600.941641:0:12010:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000225edf3/0x575506951eea1204 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.21@tcp remote: 0xa578910534661ded expref: 6 pid: 6679 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788830600.941660:0:12010:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25479a1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:12010:1875724595167104:192.168.201.21@tcp:104: 00000100:00100000:3.0:1788830600.942148:0:12010:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e255385d000 going to sleep for 11 seconds 00000100:00100000:3.0:1788830600.945134:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830600.945255:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578373888 00000100:00100000:1.0:1788830600.945268:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578373888 00002000:00100000:1.0:1788830600.945338:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9e25654e9f80 x1875724578373888/t0(0) o4->1ef2fe7a-e5ec-4085-8326-b72aa00876cd@192.168.201.21@tcp:51/0 lens 504/0 e 0 to 0 dl 1788830611 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788830600.945351:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e25654e9f80 with x1875724578373888 ext(0->8) 00010000:00010000:1.0:1788830600.945362:0:6685:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000000225edf3/0x575506951eea1204 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.21@tcp remote: 0xa578910534661ded expref: 7 pid: 6679 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.945381:0:6685:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000000225edf3/0x575506951eea1204 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.21@tcp remote: 0xa578910534661ded expref: 7 pid: 6679 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788830600.945390:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9e25654e9f80 00000100:00100000:1.0:1788830600.945477:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 1 00000100:00100000:1.0:1788830600.945488:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25654e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+7:2354:x1875724578373888:12345-192.168.201.21@tcp:4:lfs.0 00000100:00100000:1.0:1788830600.946174:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25654e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+9:2354:x1875724578373888:12345-192.168.201.21@tcp:4:lfs.0 Request processed in 684us (1051us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1788830600.946185:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 1 00002000:00100000:1.0:1788830600.946194:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9e25654e9f80 x1875724578373888/t4294967302(0) o4->1ef2fe7a-e5ec-4085-8326-b72aa00876cd@192.168.201.21@tcp:51/0 lens 504/448 e 0 to 0 dl 1788830611 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788830600.946202:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e25654e9f80 with x1875724578373888 ext(0->8) 00010000:00010000:1.0:1788830600.946209:0:6685:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000000225edf3/0x575506951eea1204 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.21@tcp remote: 0xa578910534661ded expref: 9 pid: 6679 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.946235:0:6685:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000000225edf3/0x575506951eea1204 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.21@tcp remote: 0xa578910534661ded expref: 9 pid: 6679 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788830600.946242:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9e25654e9f80 00000100:00100000:0.0:1788830600.946521:0:12010:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25479a1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:12010:1875724595167104:192.168.201.21@tcp:104: 00010000:00010000:0.0:1788830600.946554:0:12010:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000073305c70/0x575506951eea1243 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788830600.948661:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830600.948787:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578374016 00000100:00100000:3.0:1788830600.948801:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578374016 00010000:00010000:3.0:1788830600.948853:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000225edf3/0x575506951eea1204 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.21@tcp remote: 0xa578910534661ded expref: 9 pid: 6679 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788830600.948934:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 50 00000100:00100000:3.0:1788830600.948945:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2566011500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+9:2353:x1875724578374016:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788830600.948964:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1788830600.948989:0:5819:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1788830600.948993:0:5819:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788830600 00002000:00010000:3.0:1788830600.948995:0:5819:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788830600 00002000:00010000:3.0:1788830600.948997:0:5819:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1788830600 00010000:00010000:3.0:1788830600.949004:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000225edf3/0x575506951eea1204 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.21@tcp remote: 0xa578910534661ded expref: 9 pid: 6679 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830600.949030:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000225edf3/0x575506951eea1204 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.21@tcp remote: 0xa578910534661ded expref: 9 pid: 6679 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830600.949064:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000225edf3/0x575506951eea1204 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.21@tcp remote: 0xa578910534661ded expref: 9 pid: 6679 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830600.949086:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788830600.949091:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788830600.949098:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000073305c70/0x575506951eea1243 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830600.949109:0:5819:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000073305c70/0x575506951eea1243 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830600.949141:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788830600.949206:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2566011500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+8:2353:x1875724578374016:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 262us (558us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830600.949215:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 50 00010000:00010000:3.0:1788830600.949246:0:12010:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000073305c70/0x575506951eea1243 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830600.949257:0:12010:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000073305c70/0x575506951eea1243 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830600.949286:0:12010:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000073305c70/0x575506951eea1243 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830600.949295:0:12010:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000073305c70/0x575506951eea1243 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830600.949304:0:12010:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000073305c70/0x575506951eea1243 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830600.949312:0:12010:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e257d944800 already unused, calling callback (ffffffffc14cb350) 00010000:00010000:3.0:1788830600.949317:0:12010:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000073305c70/0x575506951eea1243 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830600.949327:0:12010:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000073305c70/0x575506951eea1243 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830600.949340:0:12010:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000073305c70/0x575506951eea1243 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830600.951488:0:12010:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000073305c70/0x575506951eea1243 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788830600.951603:0:12010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25658e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+7:2354:x1875724578373760:12345-192.168.201.21@tcp:1:lfs.0 Request processed in 10141us (10386us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830600.951615:0:12010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 38 00000100:00100000:0.0:1788830600.954371:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830600.954513:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578374272 00000100:00100000:3.0:1788830600.954526:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578374272 00000100:00100000:3.0:1788830600.954599:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 25 00000100:00100000:3.0:1788830600.954610:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2566012d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+37:10513:x1875724578374272:12345-192.168.201.21@tcp:35:lfs.0 00000004:00010000:3.0:1788830600.954698:0:5836:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e400/0x575506951eea1235 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661e02 expref: 37 pid: 8202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788830600.955187:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967378 00000001:00080000:3.0:1788830600.955235:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967379 00000001:00080000:3.0:1788830600.957198:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00010000:00010000:3.0:1788830600.957553:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945400/0x575506951eea124a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830600.957579:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff400/0x575506951eea11ef lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661ddf expref: 41 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830600.957590:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945400/0x575506951eea124a lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830600.957641:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff400/0x575506951eea11ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.21@tcp remote: 0xa578910534661ddf expref: 41 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830600.957682:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff400/0x575506951eea11ef lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661ddf expref: 41 pid: 5833 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788830600.957700:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25654e8a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5836:1875724595167232:192.168.201.21@tcp:104: 00000100:00100000:3.0:1788830600.958171:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e255385d240 going to sleep for 11 seconds 00000100:00100000:3.0:1788830600.961014:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25654e8a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5836:1875724595167232:192.168.201.21@tcp:104: 00010000:00010000:3.0:1788830600.961068:0:5836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945400/0x575506951eea124a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788830600.962949:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830600.963333:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578374400 00000100:00100000:1.0:1788830600.963345:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578374400 00010000:00010000:1.0:1788830600.963402:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff400/0x575506951eea11ef lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661ddf expref: 42 pid: 5833 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788830600.963449:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 51 00000100:00100000:1.0:1788830600.963460:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2566013100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+42:2355:x1875724578374400:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788830600.963480:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788830600.963488:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff400/0x575506951eea11ef lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661ddf expref: 42 pid: 5833 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.963503:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff400/0x575506951eea11ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661ddf expref: 42 pid: 5833 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.963531:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff400/0x575506951eea11ef lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661ddf expref: 42 pid: 5833 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.963551:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e257480ce00) 00010000:00010000:1.0:1788830600.963557:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945400/0x575506951eea124a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.963567:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945400/0x575506951eea124a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.963593:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945400/0x575506951eea124a lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.963633:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788830600.963705:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2566013100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+41:2355:x1875724578374400:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 246us (768us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830600.963763:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 51 00010000:00010000:2.0:1788830600.964012:0:5836:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945400/0x575506951eea124a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830600.964032:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945400/0x575506951eea124a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788830600.964211:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:2.0:1788830600.964752:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00000100:00100000:2.0:1788830600.964931:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25658e1500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5836:1875724595167360:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788830600.965034:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788830600.965075:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2548317cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788830600.965584:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595167360 00000100:00100000:1.0:1788830600.965594:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595167360 00000100:00100000:1.0:1788830600.965671:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788830600.965682:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25658e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5836:x1875724595167360:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788830600.965823:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25658e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5836:x1875724595167360:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 143us (788us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830600.965831:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1788830600.966054:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788830600.966099:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25658e1500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5836:1875724595167360:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1788830600.966602:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000100:00100000:2.0:1788830600.966668:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25658e1500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5836:1875724595167488:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788830600.966738:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788830600.966758:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2548317600 going to sleep for 11 seconds 00000100:00100000:1.0:1788830600.967037:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595167488 00000100:00100000:1.0:1788830600.967043:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595167488 00000100:00100000:1.0:1788830600.967076:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788830600.967083:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25658e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5836:x1875724595167488:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788830600.967256:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25658e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:5836:x1875724595167488:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 173us (548us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1788830600.967264:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788830600.967401:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25658e1500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5836:1875724595167488:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1788830600.967453:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00010000:00010000:2.0:1788830600.967493:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945400/0x575506951eea124a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830600.967505:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945400/0x575506951eea124a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830600.967514:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945400/0x575506951eea124a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830600.967521:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e257d945400 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:2.0:1788830600.967525:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945400/0x575506951eea124a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830600.967534:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945400/0x575506951eea124a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830600.967553:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e257480ce00) 00010000:00010000:2.0:1788830600.967556:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1788830600.967561:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945400/0x575506951eea124a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830600.967578:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945400/0x575506951eea124a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788830600.967792:0:5836:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788830600.968006:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:2.0:1788830600.968031:0:5836:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 354315320493ns, next at 355315317314ns, rc = 0 00000001:00080000:2.0:1788830600.968037:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00010000:00010000:2.0:1788830600.968071:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e257480ce00) 00010000:00010000:2.0:1788830600.968074:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788830600.968081:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e400/0x575506951eea1235 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661e02 expref: 45 pid: 8202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788830600.968183:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2566012d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+44:10513:x1875724578374272:12345-192.168.201.21@tcp:35:lfs.0 Request processed in 13576us (13829us total) trans 4294967386 rc 0/0 00000100:00100000:2.0:1788830600.968193:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 25 00000020:00080000:2.0:1788830600.968197:0:5836:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1788830600.974650:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830600.977158:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578374528 00000100:00100000:1.0:1788830600.977182:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578374528 00000100:00100000:1.0:1788830600.977333:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 99 00000100:00100000:1.0:1788830600.977347:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25479a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+44:10513:x1875724578374528:12345-192.168.201.21@tcp:101:lfs.0 00010000:00010000:1.0:1788830600.977384:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788830600.977451:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff400/0x575506951eea1251 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa578910534661e09 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.977532:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff400/0x575506951eea1251 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661e09 expref: 45 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.977551:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff400/0x575506951eea1251 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661e09 expref: 45 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830600.977575:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e257480c300) 00010000:00010000:1.0:1788830600.977579:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788830600.977583:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e25820ff400, rc 0) 00000100:00100000:1.0:1788830600.977678:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25479a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+45:10513:x1875724578374528:12345-192.168.201.21@tcp:101:lfs.0 Request processed in 334us (3042us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830600.977686:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 99 00000100:00100000:0.0:1788830600.980683:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830600.981163:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578374784 00000100:00100000:1.0:1788830600.981178:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578374784 00000100:00100000:1.0:1788830600.981256:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 26 00000100:00100000:1.0:1788830600.981269:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25629b2850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+45:10513:x1875724578374784:12345-192.168.201.21@tcp:35:lfs.0 00000100:00100000:1.0:1788830600.981805:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25629b2850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+46:10513:x1875724578374784:12345-192.168.201.21@tcp:35:lfs.0 Request processed in 536us (1135us total) trans 4294967387 rc 0/0 00000100:00100000:1.0:1788830600.981816:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 26 00000100:00100000:3.0:1788830601.055022:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830601.055141:0:8202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578374912 00000100:00100000:0.0:1788830601.055153:0:8202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578374912 00000100:00100000:0.0:1788830601.055228:0:8202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 100 00000100:00100000:0.0:1788830601.055238:0:8202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25654e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+46:10523:x1875724578374912:12345-192.168.201.21@tcp:34:lfs.0 00010000:00010000:0.0:1788830601.055316:0:8202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea1258 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830601.055350:0:8202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea1258 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830601.055362:0:8202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea1258 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830601.055377:0:8202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f000/0x575506951eea125f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830601.055384:0:8202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f000/0x575506951eea125f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830601.055389:0:8202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f000/0x575506951eea125f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830601.055472:0:8202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e400/0x575506951eea1266 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830601.055481:0:8202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e400/0x575506951eea1266 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830601.055489:0:8202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e400/0x575506951eea1266 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788830601.055531:0:8202:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e400/0x575506951eea1266 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830601.055543:0:8202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea1258 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830601.055550:0:8202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea1258 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830601.055566:0:8202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea1258 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830601.055572:0:8202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2445b7ee00 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:0.0:1788830601.055577:0:8202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea1258 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830601.055584:0:8202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea1258 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830601.055596:0:8202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e25518dc500) 00010000:00010000:0.0:1788830601.055599:0:8202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788830601.055603:0:8202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea1258 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830601.055608:0:8202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea1258 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830601.055620:0:8202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f000/0x575506951eea125f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830601.055627:0:8202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f000/0x575506951eea125f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830601.055632:0:8202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f000/0x575506951eea125f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830601.055637:0:8202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2445b7f000 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:0.0:1788830601.055640:0:8202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f000/0x575506951eea125f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830601.055657:0:8202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f000/0x575506951eea125f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830601.055664:0:8202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9e25518dcf00) 00010000:00010000:0.0:1788830601.055667:0:8202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788830601.055669:0:8202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f000/0x575506951eea125f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830601.055676:0:8202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f000/0x575506951eea125f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830601.055691:0:8202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e400/0x575506951eea1266 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830601.055696:0:8202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e400/0x575506951eea1266 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830601.055701:0:8202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e400/0x575506951eea1266 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830601.055706:0:8202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2445b7e400 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:0.0:1788830601.055769:0:8202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e400/0x575506951eea1266 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830601.055775:0:8202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e400/0x575506951eea1266 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830601.055783:0:8202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e257480c300) 00010000:00010000:0.0:1788830601.055785:0:8202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788830601.055788:0:8202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e400/0x575506951eea1266 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830601.055803:0:8202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e400/0x575506951eea1266 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788830601.055880:0:8202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25654e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+46:10523:x1875724578374912:12345-192.168.201.21@tcp:34:lfs.0 Request processed in 642us (874us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830601.055887:0:8202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 100 00000100:00100000:2.0:1788830601.088565:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830601.088700:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578375168 00000100:00100000:0.0:1788830601.088804:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578375168 00000100:00100000:0.0:1788830601.088904:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 101 00000100:00100000:0.0:1788830601.088916:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25658e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+46:10526:x1875724578375168:12345-192.168.201.21@tcp:101:lfs.0 00010000:00010000:0.0:1788830601.088937:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788830601.088972:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e400/0x575506951eea126d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa578910534661e10 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830601.089063:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f000/0x575506951eea1274 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830601.089077:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f000/0x575506951eea1274 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830601.089089:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f000/0x575506951eea1274 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830601.089104:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea127b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830601.089121:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea127b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830601.089144:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea127b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830601.089255:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ec00/0x575506951eea1282 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830601.089263:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ec00/0x575506951eea1282 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830601.089270:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ec00/0x575506951eea1282 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788830601.089291:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1788830601.089390:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f000/0x575506951eea1274 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830601.089398:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f000/0x575506951eea1274 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830601.089583:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f000/0x575506951eea1274 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830601.089589:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2445b7f000 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:0.0:1788830601.089594:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f000/0x575506951eea1274 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830601.089600:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f000/0x575506951eea1274 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830601.089612:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e25518dc500) 00010000:00010000:0.0:1788830601.089615:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788830601.089627:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f000/0x575506951eea1274 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830601.089633:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f000/0x575506951eea1274 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830601.089646:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea127b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830601.089651:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea127b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830601.089656:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea127b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830601.089660:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2445b7ee00 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:0.0:1788830601.089663:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea127b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830601.089668:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea127b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830601.089674:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9e25518dcf00) 00010000:00010000:0.0:1788830601.089676:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788830601.089679:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea127b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830601.089684:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea127b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830601.089770:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e400/0x575506951eea126d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661e10 expref: 49 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830601.089795:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ec00/0x575506951eea1282 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661e10 expref: 48 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830601.089803:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e257480c300) 00010000:00010000:0.0:1788830601.089811:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788830601.089814:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2445b7ec00, rc 0) 00000100:00100000:0.0:1788830601.089881:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25658e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+48:10526:x1875724578375168:12345-192.168.201.21@tcp:101:lfs.0 Request processed in 967us (1327us total) trans 4294967388 rc 0/0 00000100:00100000:0.0:1788830601.089888:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 101 00000100:00100000:3.0:1788830601.092809:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830601.092910:0:8202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578375296 00000100:00100000:0.0:1788830601.092919:0:8202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578375296 00000100:00100000:0.0:1788830601.092987:0:8202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 102 00000100:00100000:0.0:1788830601.092996:0:8202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25654e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+48:10526:x1875724578375296:12345-192.168.201.21@tcp:54:lfs.0 00010000:00010000:0.0:1788830601.093078:0:8202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea1290 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830601.093094:0:8202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea1290 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830601.093105:0:8202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea1290 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830601.093129:0:8202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea1290 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830601.093136:0:8202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea1290 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830601.093160:0:8202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea1290 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830601.093167:0:8202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2445b7f800 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:0.0:1788830601.093171:0:8202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea1290 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830601.093179:0:8202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea1290 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830601.093191:0:8202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e257480c300) 00010000:00010000:0.0:1788830601.093194:0:8202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788830601.093199:0:8202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea1290 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830601.093205:0:8202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea1290 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788830601.093279:0:8202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25654e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+48:10526:x1875724578375296:12345-192.168.201.21@tcp:54:lfs.0 Request processed in 284us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830601.093288:0:8202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 102 00000100:00100000:3.0:1788830601.105535:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830601.105686:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578375552 00000100:00100000:2.0:1788830601.105695:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578375552 00000100:00100000:2.0:1788830601.105835:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 27 00000100:00100000:2.0:1788830601.105843:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25478b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+48:10526:x1875724578375552:12345-192.168.201.21@tcp:35:lfs.0 00000100:00100000:2.0:1788830601.106082:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25478b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+49:10526:x1875724578375552:12345-192.168.201.21@tcp:35:lfs.0 Request processed in 239us (556us total) trans 4294967389 rc 0/0 00000100:00100000:2.0:1788830601.106087:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 27 00000100:00100000:3.0:1788830601.173398:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830601.173764:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578375808 00000100:00100000:1.0:1788830601.173780:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578375808 00000100:00100000:1.0:1788830601.173859:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 103 00000100:00100000:1.0:1788830601.173872:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25478b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+49:10537:x1875724578375808:12345-192.168.201.21@tcp:101:bash.0 00010000:00010000:1.0:1788830601.173970:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788830601.173994:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788830601.174108:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e200/0x575506951eea1212 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661df4 expref: 49 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830601.174131:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e25518dc500) 00010000:00010000:1.0:1788830601.174137:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788830601.174157:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea1297 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa578910534661e17 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830601.174367:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea129e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830601.174383:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ec00/0x575506951eea1282 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661e10 expref: 49 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830601.174392:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea129e lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830601.174434:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ec00/0x575506951eea1282 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.21@tcp remote: 0xa578910534661e10 expref: 49 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830601.174452:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ec00/0x575506951eea1282 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661e10 expref: 49 pid: 5833 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788830601.174469:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2565cc0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5834:1875724595167616:192.168.201.21@tcp:104: 00000100:00100000:1.0:1788830601.174811:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2545c71240 going to sleep for 11 seconds 00000100:00100000:3.0:1788830601.181474:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830601.181666:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2565cc0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5834:1875724595167616:192.168.201.21@tcp:104: 00010000:00010000:1.0:1788830601.181703:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea129e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788830601.182352:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578375936 00000100:00100000:2.0:1788830601.182367:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578375936 00010000:00010000:2.0:1788830601.182427:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ec00/0x575506951eea1282 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661e10 expref: 50 pid: 5833 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788830601.182485:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 52 00000100:00100000:2.0:1788830601.182497:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25478b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+50:2355:x1875724578375936:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788830601.182517:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788830601.182524:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ec00/0x575506951eea1282 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661e10 expref: 50 pid: 5833 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830601.182538:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ec00/0x575506951eea1282 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661e10 expref: 50 pid: 5833 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830601.182561:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ec00/0x575506951eea1282 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661e10 expref: 50 pid: 5833 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830601.182579:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e257480c300) 00010000:00010000:2.0:1788830601.182585:0:5819:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea129e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830601.182594:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea129e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830601.182601:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea129e lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830601.182631:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788830601.182672:0:5834:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea129e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830601.182686:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea129e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788830601.182698:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25478b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+49:2355:x1875724578375936:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 200us (1238us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830601.182706:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 52 00000004:00200000:1.0:1788830601.184038:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1788830601.184291:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea1297 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661e17 expref: 50 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830601.184328:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea129e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661e17 expref: 49 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830601.184338:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e257480c300) 00010000:00010000:1.0:1788830601.184341:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788830601.184345:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e25820fe400, rc 0) 00000100:00100000:1.0:1788830601.184498:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25478b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+49:10537:x1875724578375808:12345-192.168.201.21@tcp:101:bash.0 Request processed in 10626us (11113us total) trans 4294967390 rc 0/0 00000100:00100000:1.0:1788830601.184507:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 103 00000100:00100000:3.0:1788830601.191170:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830601.191374:0:8202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578376192 00000100:00100000:0.0:1788830601.191388:0:8202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578376192 00000100:00100000:0.0:1788830601.191467:0:8202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 104 00000100:00100000:0.0:1788830601.191482:0:8202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257fa65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+49:10537:x1875724578376192:12345-192.168.201.21@tcp:36:bash.0 00010000:00010000:0.0:1788830601.191945:0:8202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea12ac lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830601.191968:0:8202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea12ac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830601.192001:0:8202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea12ac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788830601.192076:0:8202:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967391 00000004:00010000:0.0:1788830601.192105:0:8202:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001a90abfc reply state 00000000e42a4599 transno 4294967392 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea12ac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788830601.192116:0:8202:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788830601.192241:0:8202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257fa65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+52:10537:x1875724578376192:12345-192.168.201.21@tcp:36:bash.0 Request processed in 759us (1082us total) trans 4294967392 rc 0/0 00000100:00100000:0.0:1788830601.192250:0:8202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 104 00000020:00080000:0.0:1788830601.192256:0:8202:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788830601.194458:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea12ac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830601.194478:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea12ac lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830601.194486:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea12ac lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830601.194493:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2445b7f800 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:0.0:1788830601.194499:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea12ac lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830601.194508:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea12ac lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830601.194528:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e257480c300) 00010000:00010000:0.0:1788830601.194532:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788830601.194629:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea12ac lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830601.194637:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea12ac lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788830601.196641:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830601.196784:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578376320 00000100:00100000:0.0:1788830601.196799:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578376320 00000100:00100000:0.0:1788830601.196868:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 105 00000100:00100000:0.0:1788830601.196880:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2565431500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+51:10537:x1875724578376320:12345-192.168.201.21@tcp:101:bash.0 00010000:00010000:0.0:1788830601.196926:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788830601.196954:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e400/0x575506951eea12b3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa578910534661e1e expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830601.197074:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea12ba lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830601.197092:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea129e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661e17 expref: 52 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830601.197102:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea12ba lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830601.197146:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea129e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.21@tcp remote: 0xa578910534661e17 expref: 52 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830601.197163:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea129e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661e17 expref: 52 pid: 5834 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788830601.197180:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2545cbdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5833:1875724595167744:192.168.201.21@tcp:104: 00000100:00100000:0.0:1788830601.197320:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2550b876c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788830601.202961:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2545cbdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5833:1875724595167744:192.168.201.21@tcp:104: 00010000:00010000:0.0:1788830601.203005:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea12ba lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788830601.203140:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830601.203230:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578376448 00000100:00100000:1.0:1788830601.203240:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578376448 00010000:00010000:1.0:1788830601.203290:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea129e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661e17 expref: 53 pid: 5834 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788830601.203337:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 53 00000100:00100000:1.0:1788830601.203348:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2565430e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+53:2354:x1875724578376448:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788830601.203366:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788830601.203387:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea129e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661e17 expref: 53 pid: 5834 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830601.203399:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea129e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661e17 expref: 53 pid: 5834 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830601.203426:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea129e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661e17 expref: 53 pid: 5834 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830601.203445:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e257480c300) 00010000:00010000:1.0:1788830601.203451:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea12ba lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830601.203463:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea12ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830601.203472:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea12ba lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830601.203505:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788830601.203585:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2565430e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+52:2354:x1875724578376448:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 238us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830601.203594:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 53 00010000:00010000:0.0:1788830601.204142:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea12ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830601.204152:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea12ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788830601.204215:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1788830601.204220:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788830601.204245:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea12ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830601.204285:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e400/0x575506951eea12b3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661e1e expref: 52 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830601.204320:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea12ba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661e1e expref: 51 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830601.204329:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e257480c300) 00010000:00010000:0.0:1788830601.204333:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788830601.204335:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2445b7ee00, rc 0) 00000100:00100000:0.0:1788830601.204402:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2565431500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+51:10537:x1875724578376320:12345-192.168.201.21@tcp:101:bash.0 Request processed in 7524us (7784us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830601.204410:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 105 00000100:00100000:3.0:1788830601.207958:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830601.208135:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578376704 00000100:00100000:1.0:1788830601.208149:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578376704 00000100:00100000:1.0:1788830601.208216:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 28 00000100:00100000:1.0:1788830601.208228:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2565433800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+51:10537:x1875724578376704:12345-192.168.201.21@tcp:35:bash.0 00000100:00100000:1.0:1788830601.208568:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2565433800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+52:10537:x1875724578376704:12345-192.168.201.21@tcp:35:bash.0 Request processed in 342us (621us total) trans 4294967393 rc 0/0 00000100:00100000:1.0:1788830601.208597:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 28 00010000:00010000:0.0:1788830601.246232:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788830601.272577:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830601.273312:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578376832 00000100:00100000:0.0:1788830601.273327:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578376832 00000100:00100000:0.0:1788830601.273407:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 106 00000100:00100000:0.0:1788830601.273418:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25658e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+52:10543:x1875724578376832:12345-192.168.201.21@tcp:101:lfs.0 00010000:00010000:0.0:1788830601.273450:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788830601.273476:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e400/0x575506951eea12c1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa578910534661e25 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830601.273555:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea12c8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830601.273570:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea12c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830601.273583:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea12c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788830601.273624:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1788830601.273627:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788830601.273647:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea12c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830601.273674:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e400/0x575506951eea12c1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661e25 expref: 54 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830601.273695:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea12c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661e25 expref: 53 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830601.273705:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e25518dc500) 00010000:00010000:0.0:1788830601.273766:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788830601.273779:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2445b7f800, rc 0) 00000100:00100000:0.0:1788830601.273853:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25658e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+53:10543:x1875724578376832:12345-192.168.201.21@tcp:101:lfs.0 Request processed in 436us (1290us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830601.273861:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 106 00000100:00100000:3.0:1788830601.278148:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830601.278251:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578376960 00000100:00100000:1.0:1788830601.278264:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578376960 00000100:00100000:1.0:1788830601.278352:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 107 00000100:00100000:1.0:1788830601.278365:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2565433100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+53:10543:x1875724578376960:12345-192.168.201.21@tcp:101:lfs.0 00010000:00010000:1.0:1788830601.278395:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788830601.278420:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea12cf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa578910534661e2c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830601.278501:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea12d6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830601.278517:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea12d6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830601.278530:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea12d6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830601.278546:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffa00/0x575506951eea12dd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830601.278553:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffa00/0x575506951eea12dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830601.278559:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffa00/0x575506951eea12dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830601.278668:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffe00/0x575506951eea12e4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830601.278859:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffe00/0x575506951eea12e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830601.278870:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffe00/0x575506951eea12e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788830601.278919:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1788830601.278925:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788830601.278948:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffe00/0x575506951eea12e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830601.278962:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffe00/0x575506951eea12e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830601.278972:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea12d6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830601.278979:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea12d6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830601.278986:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea12d6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830601.278993:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e25820ff800 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:1.0:1788830601.278998:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea12d6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830601.279007:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea12d6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830601.279031:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e25518dc500) 00010000:00010000:1.0:1788830601.279034:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788830601.279048:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea12d6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830601.279054:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea12d6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830601.279072:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffa00/0x575506951eea12dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830601.279079:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffa00/0x575506951eea12dd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830601.279084:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffa00/0x575506951eea12dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830601.279090:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e25820ffa00 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:1.0:1788830601.279093:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffa00/0x575506951eea12dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830601.279099:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffa00/0x575506951eea12dd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830601.279108:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9e257480c700) 00010000:00010000:1.0:1788830601.279110:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788830601.279113:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffa00/0x575506951eea12dd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830601.279118:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffa00/0x575506951eea12dd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830601.279157:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea12cf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661e2c expref: 55 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830601.279193:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffe00/0x575506951eea12e4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661e2c expref: 54 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830601.279201:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e257480c300) 00010000:00010000:1.0:1788830601.279204:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788830601.279206:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e25820ffe00, rc 0) 00000100:00100000:1.0:1788830601.279552:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2565433100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+54:10543:x1875724578376960:12345-192.168.201.21@tcp:101:lfs.0 Request processed in 1188us (1417us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830601.279561:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 107 00000100:00100000:2.0:1788830601.284025:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830601.285459:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830601.285570:0:11161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578377344 00000100:00100000:2.0:1788830601.285583:0:11161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578377344 00000100:00100000:2.0:1788830601.285672:0:11161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 7 00000100:00100000:2.0:1788830601.285685:0:11161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2565430a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+54:2354:x1875724578377344:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788830601.285746:0:11161:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788830601.285780:0:11161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffe00/0x575506951eea12e4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661e2c expref: 54 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830601.285807:0:11161:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e257480c300) 00010000:00010000:2.0:1788830601.285813:0:11161:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788830601.285897:0:11161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2565430a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+53:2354:x1875724578377344:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 213us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830601.285905:0:11161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 7 00000100:00100000:0.0:1788830601.287097:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578377216 00000100:00100000:0.0:1788830601.287114:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578377216 00000100:00100000:0.0:1788830601.287176:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 108 00000100:00100000:0.0:1788830601.287187:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25658e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+53:10543:x1875724578377216:12345-192.168.201.21@tcp:101:lfs.0 00010000:00010000:0.0:1788830601.287213:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788830601.287238:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e400/0x575506951eea12eb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa578910534661e33 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830601.287390:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f000/0x575506951eea12f2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830601.287409:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea12ba lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661e1e expref: 54 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830601.287419:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f000/0x575506951eea12f2 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830601.287463:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea12ba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.21@tcp remote: 0xa578910534661e1e expref: 54 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830601.287480:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea12ba lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661e1e expref: 54 pid: 5833 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788830601.287496:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2545cbdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5832:1875724595167872:192.168.201.21@tcp:104: 00000100:00100000:0.0:1788830601.287852:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2550b87000 going to sleep for 11 seconds 00000100:00100000:2.0:1788830601.291912:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830601.292158:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2545cbdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5832:1875724595167872:192.168.201.21@tcp:104: 00010000:00010000:0.0:1788830601.292195:0:5832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f000/0x575506951eea12f2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788830601.292281:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578377472 00000100:00100000:1.0:1788830601.292290:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578377472 00010000:00010000:1.0:1788830601.292349:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea12ba lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661e1e expref: 55 pid: 5833 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788830601.292393:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 54 00000100:00100000:1.0:1788830601.292404:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255da69450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+55:2355:x1875724578377472:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788830601.292426:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788830601.292435:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea12ba lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661e1e expref: 55 pid: 5833 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830601.292448:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea12ba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661e1e expref: 55 pid: 5833 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830601.292476:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea12ba lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661e1e expref: 55 pid: 5833 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830601.292520:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e257480c300) 00010000:00010000:1.0:1788830601.292526:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f000/0x575506951eea12f2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830601.292537:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f000/0x575506951eea12f2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830601.292546:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f000/0x575506951eea12f2 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830601.292579:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788830601.292654:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255da69450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+54:2355:x1875724578377472:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 251us (755us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830601.292662:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 54 00010000:00010000:0.0:1788830601.292853:0:5832:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f000/0x575506951eea12f2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830601.292861:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f000/0x575506951eea12f2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788830601.292886:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1788830601.293109:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e400/0x575506951eea12eb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661e33 expref: 55 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830601.293127:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f000/0x575506951eea12f2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661e33 expref: 54 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830601.293137:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e257480c300) 00010000:00010000:0.0:1788830601.293140:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788830601.293143:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2445b7f000, rc 0) 00000100:00100000:0.0:1788830601.293175:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25658e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+54:10543:x1875724578377216:12345-192.168.201.21@tcp:101:lfs.0 Request processed in 5991us (9177us total) trans 4294967394 rc 0/0 00000100:00100000:0.0:1788830601.293183:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 108 00000100:00100000:1.0:1788830601.296828:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830601.297422:0:11161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578377728 00000100:00100000:2.0:1788830601.297436:0:11161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578377728 00000100:00100000:2.0:1788830601.297551:0:11161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 8 00000100:00100000:2.0:1788830601.297564:0:11161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2565cc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+54:10543:x1875724578377728:12345-192.168.201.21@tcp:103:lfs.0 00010000:00010000:2.0:1788830601.297586:0:11161:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788830601.297617:0:11161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff400/0x575506951eea1251 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661e09 expref: 54 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830601.297641:0:11161:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e257480c300) 00010000:00010000:2.0:1788830601.297647:0:11161:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788830601.297745:0:11161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2565cc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+53:10543:x1875724578377728:12345-192.168.201.21@tcp:103:lfs.0 Request processed in 183us (930us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830601.297776:0:11161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 8 00000100:00100000:2.0:1788830601.300872:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830601.301152:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578377856 00000100:00100000:0.0:1788830601.301166:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578377856 00000100:00100000:0.0:1788830601.301239:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 109 00000100:00100000:0.0:1788830601.301252:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25658e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+53:10543:x1875724578377856:12345-192.168.201.21@tcp:58:lfs.0 00010000:00010000:0.0:1788830601.301388:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e400/0x575506951eea1300 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830601.301427:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e400/0x575506951eea1300 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830601.301442:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e400/0x575506951eea1300 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788830601.301690:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:0.0:1788830601.301833:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25658e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+53:10543:x1875724578377856:12345-192.168.201.21@tcp:58:lfs.0 Request processed in 583us (975us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830601.301842:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 109 00000100:00100000:2.0:1788830601.304807:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830601.304919:0:8202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578377984 00000100:00100000:3.0:1788830601.304935:0:8202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578377984 00000100:00100000:3.0:1788830601.305005:0:8202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 110 00000100:00100000:3.0:1788830601.305028:0:8202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25658e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+53:10543:x1875724578377984:12345-192.168.201.21@tcp:101:lfs.0 00010000:00010000:3.0:1788830601.305058:0:8202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788830601.305111:0:8202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944400/0x575506951eea1307 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa578910534661e3a expref: -99 pid: 8202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830601.305188:0:8202:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e400/0x575506951eea1300 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830601.305201:0:8202:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944400/0x575506951eea1307 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661e3a expref: 54 pid: 8202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830601.305226:0:8202:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e400/0x575506951eea1300 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830601.305242:0:8202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944400/0x575506951eea1307 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661e3a expref: 54 pid: 8202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830601.305258:0:8202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e257480c300) 00010000:00010000:3.0:1788830601.305262:0:8202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788830601.305267:0:8202:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944400/0x575506951eea1307 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661e3a expref: 54 pid: 8202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830601.305276:0:8202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e257d944400, rc 0) 00000100:00100000:3.0:1788830601.305374:0:8202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25658e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+54:10543:x1875724578377984:12345-192.168.201.21@tcp:101:lfs.0 Request processed in 349us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830601.305382:0:8202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 110 00000001:00080000:1.0:1788830601.557663:0:7646:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000001:00080000:1.0:1788830601.557682:0:7646:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00080000:1.0:1788830601.557687:0:7646:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000040:00080000:0.0:1788830601.884378:0:11676:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788830601.884389:0:11676:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788830601.884448:0:11676:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:0.0:1788830601.884456:0:11676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788830601.884596:0:11676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2545cbdc00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11676:1875724595168000:192.168.201.21@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788830601.884704:0:11676:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2550b87840 going to sleep for 11 seconds 00000100:00100000:2.0:1788830601.894804:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830601.894920:0:11676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2545cbdc00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11676:1875724595168000:192.168.201.21@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788830601.894972:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578378112 00000100:00100000:1.0:1788830601.894980:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578378112 00000100:00100000:1.0:1788830601.895054:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 111 00000100:00100000:1.0:1788830601.895063:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25658e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+54:10544:x1875724578378112:12345-192.168.201.21@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788830601.895093:0:5833:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788830601.895207:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25658e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+54:10544:x1875724578378112:12345-192.168.201.21@tcp:53:lhsmtool_posix.0 Request processed in 145us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830601.895214:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 111 00000100:00100000:2.0:1788830601.899794:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830601.900019:0:8202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578378240 00000100:00100000:3.0:1788830601.900033:0:8202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578378240 00000100:00100000:3.0:1788830601.900106:0:8202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 112 00000100:00100000:3.0:1788830601.900118:0:8202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25658e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+54:10544:x1875724578378240:12345-192.168.201.21@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788830601.900217:0:8202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944800/0x575506951eea130e lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830601.900596:0:8202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944800/0x575506951eea130e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830601.900614:0:8202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944800/0x575506951eea130e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830601.900856:0:8202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945400/0x575506951eea1315 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830601.900879:0:8202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945400/0x575506951eea1315 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830601.900892:0:8202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945400/0x575506951eea1315 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830601.900928:0:8202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945c00/0x575506951eea131c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830601.900938:0:8202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945c00/0x575506951eea131c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830601.900945:0:8202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945c00/0x575506951eea131c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788830601.900989:0:8202:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1788830601.900994:0:8202:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788830601.901020:0:8202:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945c00/0x575506951eea131c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830601.901333:0:8202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944800/0x575506951eea130e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830601.901356:0:8202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944800/0x575506951eea130e lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830601.901362:0:8202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944800/0x575506951eea130e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830601.901368:0:8202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e257d944800 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:3.0:1788830601.901372:0:8202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944800/0x575506951eea130e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830601.901378:0:8202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944800/0x575506951eea130e lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830601.901392:0:8202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e257480cd00) 00010000:00010000:3.0:1788830601.901395:0:8202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788830601.901399:0:8202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944800/0x575506951eea130e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830601.901405:0:8202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944800/0x575506951eea130e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830601.901422:0:8202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945400/0x575506951eea1315 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830601.901427:0:8202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945400/0x575506951eea1315 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830601.901433:0:8202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945400/0x575506951eea1315 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830601.901438:0:8202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e257d945400 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:3.0:1788830601.901448:0:8202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945400/0x575506951eea1315 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830601.901455:0:8202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945400/0x575506951eea1315 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830601.901464:0:8202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff9e25530b0c00) 00010000:00010000:3.0:1788830601.901467:0:8202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788830601.901470:0:8202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945400/0x575506951eea1315 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830601.901476:0:8202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945400/0x575506951eea1315 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830601.901496:0:8202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945c00/0x575506951eea131c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830601.901502:0:8202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945c00/0x575506951eea131c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830601.901508:0:8202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945c00/0x575506951eea131c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830601.901513:0:8202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e257d945c00 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:3.0:1788830601.901515:0:8202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945c00/0x575506951eea131c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830601.901520:0:8202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945c00/0x575506951eea131c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830601.901527:0:8202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e257480c300) 00010000:00010000:3.0:1788830601.901529:0:8202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788830601.901539:0:8202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945c00/0x575506951eea131c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830601.901545:0:8202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945c00/0x575506951eea131c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788830601.901641:0:8202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25658e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+54:10544:x1875724578378240:12345-192.168.201.21@tcp:34:lhsmtool_posix.0 Request processed in 1520us (1860us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830601.901650:0:8202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 112 00000100:00100000:2.0:1788830601.909869:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830601.909989:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578378496 00000100:00100000:3.0:1788830601.910016:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578378496 00000100:00100000:3.0:1788830601.910099:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 113 00000100:00100000:3.0:1788830601.910112:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25658e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+54:10544:x1875724578378496:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788830601.910138:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788830601.910167:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945c00/0x575506951eea1323 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa578910534661e41 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830601.910315:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945400/0x575506951eea132a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830601.910336:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945400/0x575506951eea132a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830601.910350:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945400/0x575506951eea132a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788830601.910364:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1788830601.910498:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945400/0x575506951eea132a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830601.910507:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945400/0x575506951eea132a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830601.910527:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945400/0x575506951eea132a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830601.910534:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e257d945400 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:3.0:1788830601.910539:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945400/0x575506951eea132a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830601.910547:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945400/0x575506951eea132a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830601.910560:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e257480c300) 00010000:00010000:3.0:1788830601.910563:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788830601.910568:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945400/0x575506951eea132a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830601.910575:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945400/0x575506951eea132a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830601.910622:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945c00/0x575506951eea1323 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661e41 expref: 56 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830601.910632:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e257480cd00) 00010000:00010000:3.0:1788830601.910635:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788830601.910638:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945c00/0x575506951eea1323 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661e41 expref: 56 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830601.910648:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e257d945c00, rc 0) 00000100:00100000:3.0:1788830601.910746:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25658e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+55:10544:x1875724578378496:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 Request processed in 637us (894us total) trans 4294967395 rc 301/301 00000100:00100000:3.0:1788830601.910762:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 113 00000100:00100000:2.0:1788830601.919831:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830601.919949:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578378624 00000100:00100000:0.0:1788830601.919963:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578378624 00000100:00100000:0.0:1788830601.920044:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 114 00000100:00100000:0.0:1788830601.920056:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25658e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+55:10544:x1875724578378624:12345-192.168.201.21@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788830601.920103:0:5832:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788830601.920283:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25658e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+55:10544:x1875724578378624:12345-192.168.201.21@tcp:53:lhsmtool_posix.0 Request processed in 229us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830601.920291:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 114 00000100:00100000:2.0:1788830601.932984:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830601.936458:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578378880 00000100:00100000:1.0:1788830601.936504:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578378880 00000100:00100000:1.0:1788830601.936675:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 115 00000100:00100000:1.0:1788830601.936689:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25658e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+55:10544:x1875724578378880:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788830601.936739:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788830601.936743:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788830601.936783:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea12c8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661e25 expref: 55 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830601.936809:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e25518dc500) 00010000:00010000:1.0:1788830601.936815:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788830601.937339:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffa00/0x575506951eea1338 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa578910534661e48 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788830601.938626:0:5833:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:1.0:1788830601.939022:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea133f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830601.939042:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea133f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830601.939056:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea133f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830601.939134:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffa00/0x575506951eea1338 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661e48 expref: 57 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830601.939158:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea133f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661e48 expref: 56 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830601.939191:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9e257480c900) 00010000:00010000:1.0:1788830601.939194:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788830601.939198:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e25820ff800, rc 0) 00000100:00100000:1.0:1788830601.939340:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25658e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+56:10544:x1875724578378880:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 Request processed in 2652us (6369us total) trans 4294967396 rc 0/0 00000100:00100000:1.0:1788830601.939350:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 115 00000100:00100000:3.0:1788830601.944941:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830601.945060:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578379136 00000100:00100000:0.0:1788830601.945107:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578379136 00000100:00100000:0.0:1788830601.945185:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 116 00000100:00100000:0.0:1788830601.945198:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2565430000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+56:10544:x1875724578379136:12345-192.168.201.21@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788830601.945592:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788830601.945630:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea133f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661e48 expref: 56 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830601.945656:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9e257480c900) 00010000:00010000:0.0:1788830601.945674:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788830601.945706:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea134d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830601.947809:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea134d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830601.947829:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea134d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830601.947866:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ec00/0x575506951eea1354 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x6da95aa7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830601.947873:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ec00/0x575506951eea1354 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x6da95aa7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830601.947881:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ec00/0x575506951eea1354 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x6da95aa7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830601.947979:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea134d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830601.947986:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea134d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830601.948023:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea134d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830601.948029:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2445b7ee00 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:0.0:1788830601.948033:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea134d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830601.948043:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea134d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830601.948057:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e25518dc500) 00010000:00010000:0.0:1788830601.948061:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788830601.948066:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea134d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830601.948073:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea134d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830601.949081:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ec00/0x575506951eea1354 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x6da95aa7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830601.949105:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ec00/0x575506951eea1354 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x6da95aa7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830601.949111:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ec00/0x575506951eea1354 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x6da95aa7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830601.949117:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2445b7ec00 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:0.0:1788830601.949121:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ec00/0x575506951eea1354 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x6da95aa7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830601.949144:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ec00/0x575506951eea1354 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x6da95aa7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830601.949156:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x6da95aa7 (ffff9e25518dcf00) 00010000:00010000:0.0:1788830601.949159:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788830601.949163:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ec00/0x575506951eea1354 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x6da95aa7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830601.949170:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ec00/0x575506951eea1354 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x6da95aa7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788830601.949370:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2565430000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+55:10544:x1875724578379136:12345-192.168.201.21@tcp:36:lhsmtool_posix.0 Request processed in 4166us (4437us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788830601.949381:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 116 00000100:00100000:3.0:1788830601.949792:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000004:00080000:2.0:1788830601.949962:0:6697:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 355297250912ns, next at 356297247646ns, rc = 0 00000100:00100000:3.0:1788830601.952150:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25658e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875724595168128:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788830601.952429:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830601.953353:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830601.954068:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578379264 00000100:00100000:1.0:1788830601.955075:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595168128 00000100:00100000:1.0:1788830601.955085:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595168128 00000100:00100000:1.0:1788830601.955180:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788830601.955193:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2565430e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1875724595168128:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788830601.955220:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:1.0:1788830601.955256:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788830601.955363:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2565430e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1875724595168128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 172us (2934us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830601.955370:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788830601.955441:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25658e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875724595168128:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788830601.955492:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578379264 00000100:00100000:2.0:1788830601.955581:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 117 00000100:00100000:2.0:1788830601.955590:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2565430a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+55:10544:x1875724578379264:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788830601.955607:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788830601.955642:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729600/0x575506951eea135b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa578910534661e4f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830601.955687:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728a00/0x575506951eea1362 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830601.955731:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728a00/0x575506951eea1362 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830601.955746:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728a00/0x575506951eea1362 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830601.955893:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729600/0x575506951eea135b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661e4f expref: 57 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830601.955931:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728a00/0x575506951eea1362 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661e4f expref: 56 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830601.955942:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9e2551f3e500) 00010000:00010000:2.0:1788830601.955945:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788830601.955949:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2565728a00, rc 0) 00000100:00100000:2.0:1788830601.956015:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2565430a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+56:10544:x1875724578379264:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 Request processed in 426us (2668us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830601.956022:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 117 00000100:00100000:1.0:1788830601.960511:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830601.960641:0:8202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578379520 00000100:00100000:0.0:1788830601.960653:0:8202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578379520 00000100:00100000:0.0:1788830601.960757:0:8202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 118 00000100:00100000:0.0:1788830601.960770:0:8202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2565cc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+56:10544:x1875724578379520:12345-192.168.201.21@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788830601.960884:0:8202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e200/0x575506951eea1369 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830601.960907:0:8202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e200/0x575506951eea1369 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830601.960920:0:8202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e200/0x575506951eea1369 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788830601.961378:0:8202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00010000:0.0:1788830601.961499:0:8202:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000de8a7e27 reply state 00000000c4386165 transno 4294967397 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e200/0x575506951eea1369 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788830601.961511:0:8202:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788830601.961803:0:8202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2565cc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+58:10544:x1875724578379520:12345-192.168.201.21@tcp:36:lhsmtool_posix.0 Request processed in 1032us (1301us total) trans 4294967397 rc 0/0 00000100:00100000:0.0:1788830601.961812:0:8202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 118 00010000:00010000:1.0:1788830601.968183:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e200/0x575506951eea1369 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830601.968209:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e200/0x575506951eea1369 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830601.968218:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e200/0x575506951eea1369 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830601.968225:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2445b7e200 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:1.0:1788830601.968231:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e200/0x575506951eea1369 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830601.968275:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e200/0x575506951eea1369 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830601.968297:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9e2551f3e500) 00010000:00010000:1.0:1788830601.968301:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788830601.968306:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e200/0x575506951eea1369 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830601.968325:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e200/0x575506951eea1369 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788830601.969208:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830601.969353:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578379648 00000100:00100000:0.0:1788830601.969366:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578379648 00000100:00100000:0.0:1788830601.969442:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 119 00000100:00100000:0.0:1788830601.969455:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2565cc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+57:10544:x1875724578379648:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788830601.969486:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788830601.969509:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ec00/0x575506951eea1370 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa578910534661e56 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830601.969603:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ec00/0x575506951eea1370 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661e56 expref: 58 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830601.969622:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ec00/0x575506951eea1370 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661e56 expref: 58 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830601.969645:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9e2551f3e500) 00010000:00010000:0.0:1788830601.969649:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788830601.969652:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2445b7ec00, rc 0) 00000100:00100000:0.0:1788830601.969763:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2565cc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+58:10544:x1875724578379648:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 Request processed in 311us (562us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830601.969785:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 119 00000100:00100000:3.0:1788830601.975966:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830601.976197:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578379776 00000100:00100000:0.0:1788830601.976213:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578379776 00000100:00100000:0.0:1788830601.976304:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 39 00000100:00100000:0.0:1788830601.976318:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2547240a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+8:2355:x1875724578379776:12345-192.168.201.21@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1788830601.977023:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2547240a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+9:2355:x1875724578379776:12345-192.168.201.21@tcp:2:lhsmtool_posix.0 Request processed in 703us (1067us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1788830601.977033:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 39 00000100:00100000:1.0:1788830601.980318:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830601.980492:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578380032 00000100:00100000:0.0:1788830601.980505:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578380032 00000100:00100000:0.0:1788830601.980636:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 29 00000100:00100000:0.0:1788830601.980648:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2565cc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+58:10544:x1875724578380032:12345-192.168.201.21@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788830601.981031:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2565cc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+59:10544:x1875724578380032:12345-192.168.201.21@tcp:35:lhsmtool_posix.0 Request processed in 383us (727us total) trans 4294967398 rc 0/0 00000100:00100000:0.0:1788830601.981040:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 29 00000100:00100000:1.0:1788830601.984089:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830601.984420:0:8202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578380288 00000100:00100000:3.0:1788830601.984433:0:8202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578380288 00000100:00100000:3.0:1788830601.984511:0:8202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 120 00000100:00100000:3.0:1788830601.984531:0:8202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25478b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+59:10544:x1875724578380288:12345-192.168.201.21@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788830601.984671:0:8202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25478b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+59:10544:x1875724578380288:12345-192.168.201.21@tcp:57:lhsmtool_posix.0 Request processed in 151us (596us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830601.984680:0:8202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 120 00000100:00100000:3.0:1788830601.987377:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830601.987570:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578380416 00000100:00100000:1.0:1788830601.987584:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578380416 00000100:00100000:1.0:1788830601.987656:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 121 00000100:00100000:1.0:1788830601.987667:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2547242d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+59:10544:x1875724578380416:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788830601.987704:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788830601.987761:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffe00/0x575506951eea1377 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa578910534661e5d expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830601.987856:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea137e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830601.987883:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea137e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830601.987897:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea137e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788830601.987964:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788830601.987990:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea137e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830601.988060:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffe00/0x575506951eea1377 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661e5d expref: 61 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830601.988082:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea137e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661e5d expref: 60 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830601.988091:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9e2551f3e500) 00010000:00010000:1.0:1788830601.988095:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788830601.988098:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e25820fe400, rc 0) 00000100:00100000:1.0:1788830601.988170:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2547242d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+60:10544:x1875724578380416:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 Request processed in 505us (806us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830601.988177:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 121 00000100:00100000:1.0:1788830601.991954:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830601.992107:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578380544 00000100:00100000:2.0:1788830601.992121:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578380544 00000100:00100000:2.0:1788830601.992199:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 40 00000100:00100000:2.0:1788830601.992211:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255005ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+9:2354:x1875724578380544:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788830601.992245:0:6677:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788830601.992277:0:6677:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000052d0b734/0x575506951eea1385 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa578910534661e64 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788830601.992313:0:6677:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9f6389, blocks: 0x1 00010000:00010000:2.0:1788830601.992335:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=355s v=(0 0) 00010000:00010000:2.0:1788830601.992341:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788830601.992352:0:6677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000052d0b734/0x575506951eea1385 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661e64 expref: 10 pid: 6677 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830601.992377:0:6677:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000052d0b734/0x575506951eea1385 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661e64 expref: 10 pid: 6677 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830601.992415:0:6677:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2565729600, rc 0) 00000100:00100000:2.0:1788830601.992492:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255005ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+10:2354:x1875724578380544:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 Request processed in 283us (554us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830601.992499:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 40 00000100:00100000:1.0:1788830601.997916:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830601.998075:0:8202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578380800 00000100:00100000:3.0:1788830601.998090:0:8202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578380800 00000100:00100000:3.0:1788830601.998166:0:8202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 122 00000100:00100000:3.0:1788830601.998179:0:8202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25654d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+60:10544:x1875724578380800:12345-192.168.201.21@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788830601.998352:0:8202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25654d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+60:10544:x1875724578380800:12345-192.168.201.21@tcp:57:lhsmtool_posix.0 Request processed in 175us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830601.998360:0:8202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 122 00000100:00100000:1.0:1788830602.002097:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830602.002469:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578380928 00000100:00100000:2.0:1788830602.002482:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578380928 00000100:00100000:2.0:1788830602.002585:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 41 00000100:00100000:2.0:1788830602.002600:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25654d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+10:10544:x1875724578380928:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788830602.002625:0:6679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788830602.002649:0:6679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6244189/0x575506951eea138c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa578910534661e6b expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830602.002690:0:6679:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000052d0b734/0x575506951eea1385 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661e64 expref: 11 pid: 6677 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830602.002701:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788830602.002706:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00000100:00080000:0.0:1788830602.003029:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788830602.003123:0:6679:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6244189/0x575506951eea138c lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661e6b expref: 11 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830602.003248:0:6679:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000052d0b734/0x575506951eea1385 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.21@tcp remote: 0xa578910534661e64 expref: 11 pid: 6677 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830602.003267:0:6679:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000052d0b734/0x575506951eea1385 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661e64 expref: 11 pid: 6677 timeout: 455 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788830602.003285:0:6679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2566011500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6679:1875724595168256:192.168.201.21@tcp:104: 00000100:00100000:1.0:1788830602.003430:0:6679:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2444a6c600 going to sleep for 11 seconds 00000100:00100000:1.0:1788830602.009404:0:6679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2566011500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6679:1875724595168256:192.168.201.21@tcp:104: 00010000:00010000:1.0:1788830602.009457:0:6679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6244189/0x575506951eea138c lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.21@tcp remote: 0xa578910534661e6b expref: 11 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830602.009488:0:6679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2565729400, rc 0) 00000100:00100000:1.0:1788830602.009582:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25654d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+11:10544:x1875724578380928:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 Request processed in 6984us (7497us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830602.009593:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 41 00000100:00100000:0.0:1788830602.009901:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830602.010446:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578381056 00000100:00100000:1.0:1788830602.010460:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578381056 00010000:00010000:1.0:1788830602.010513:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000052d0b734/0x575506951eea1385 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661e64 expref: 11 pid: 6677 timeout: 455 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788830602.010566:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 55 00000100:00100000:1.0:1788830602.010578:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2545cbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+11:2354:x1875724578381056:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788830602.010598:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788830602.010630:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000052d0b734/0x575506951eea1385 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661e64 expref: 11 pid: 6677 timeout: 455 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830602.010646:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000052d0b734/0x575506951eea1385 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661e64 expref: 11 pid: 6677 timeout: 455 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830602.010677:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000052d0b734/0x575506951eea1385 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661e64 expref: 11 pid: 6677 timeout: 455 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830602.010856:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788830602.010861:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788830602.010872:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6244189/0x575506951eea138c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.21@tcp remote: 0xa578910534661e6b expref: 10 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830602.010894:0:5818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6244189/0x575506951eea138c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.21@tcp remote: 0xa578910534661e6b expref: 10 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830602.010944:0:5818:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000d6244189/0x575506951eea138c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.21@tcp remote: 0xa578910534661e6b expref: 10 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788830602.010962:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2566011500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5818:1875724595168384:192.168.201.21@tcp:105: 00000100:00100000:1.0:1788830602.011072:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2444a6c600 going to sleep for 11 seconds 00000100:00100000:1.0:1788830602.017626:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2566011500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5818:1875724595168384:192.168.201.21@tcp:105: 00010000:00010000:1.0:1788830602.017667:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788830602.017790:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2545cbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+10:2354:x1875724578381056:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 7212us (7888us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830602.017802:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 55 00000100:00100000:2.0:1788830602.021907:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830602.022126:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578381184 00000100:00100000:3.0:1788830602.022138:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578381184 00002000:00100000:3.0:1788830602.022202:0:6684:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9e25658e0000 x1875724578381184/t0(0) o4->1ef2fe7a-e5ec-4085-8326-b72aa00876cd@192.168.201.21@tcp:53/0 lens 504/0 e 0 to 0 dl 1788830613 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788830602.022228:0:6684:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e25658e0000 with x1875724578381184 ext(0->12) 00002000:00010000:3.0:1788830602.022245:0:6684:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e25658e0000 00000100:00100000:3.0:1788830602.022282:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 2 00000100:00100000:3.0:1788830602.022293:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25658e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+10:2355:x1875724578381184:12345-192.168.201.21@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788830602.023201:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25658e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+12:2355:x1875724578381184:12345-192.168.201.21@tcp:4:lhsmtool_posix.0 Request processed in 903us (1303us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1788830602.023212:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 2 00002000:00100000:3.0:1788830602.023224:0:6684:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9e25658e0000 x1875724578381184/t4294967308(0) o4->1ef2fe7a-e5ec-4085-8326-b72aa00876cd@192.168.201.21@tcp:53/0 lens 504/448 e 0 to 0 dl 1788830613 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788830602.024206:0:6684:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e25658e0000 with x1875724578381184 ext(0->12) 00002000:00010000:3.0:1788830602.024218:0:6684:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e25658e0000 00000100:00100000:3.0:1788830602.026672:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830602.027214:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578381312 00000100:00100000:1.0:1788830602.027229:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578381312 00000100:00100000:1.0:1788830602.027335:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 123 00000100:00100000:1.0:1788830602.027349:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2547241880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+60:10544:x1875724578381312:12345-192.168.201.21@tcp:44:lhsmtool_posix.0 00000100:00080000:0.0:1788830602.027741:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788830602.075731:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2547241880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+60:10544:x1875724578381312:12345-192.168.201.21@tcp:44:lhsmtool_posix.0 Request processed in 48337us (49026us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830602.075750:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 123 00000001:00080000:3.0:1788830602.076015:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967398 is committed 00000004:00080000:3.0:1788830602.076067:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000004:00080000:3.0:1788830602.076134:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000004:00080000:3.0:1788830602.076143:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:3.0:1788830602.076164:0:5855:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9e2548317cc0 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:3.0:1788830602.076170:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9e256544ca00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9e2548317540 00000020:00080000:3.0:1788830602.076173:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9e256544cb00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9e2565484800 00000020:00080000:3.0:1788830602.076191:0:5855:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9e25483176c0 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:3.0:1788830602.076194:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9e256568df00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9e2548317840 00000020:00080000:3.0:1788830602.076197:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9e256568d700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9e2565b52800 00000020:00080000:3.0:1788830602.076226:0:5855:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000020:00080000:3.0:1788830602.076262:0:5866:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:3.0:1788830602.076534:0:5866:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:2.0:1788830602.076835:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788830602.076858:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e255130ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875724595168512:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788830602.077085:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788830602.077178:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595168512 00000100:00100000:2.0:1788830602.077188:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595168512 00000100:00100000:2.0:1788830602.077321:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788830602.077333:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2551309f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3310:x1875724595168512:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788830602.077371:0:6677:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00010000:00010000:2.0:1788830602.077409:0:6677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009f4303fc/0x575506951eea1393 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830602.077437:0:6677:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000037589048/0x575506951eea1155 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.21@tcp remote: 0xa578910534661dca expref: 11 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830602.077448:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1788830602.077453:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788830602.077459:0:6677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009f4303fc/0x575506951eea1393 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830602.077519:0:6677:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000037589048/0x575506951eea1155 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.21@tcp remote: 0xa578910534661dca expref: 11 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830602.077538:0:6677:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000037589048/0x575506951eea1155 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.21@tcp remote: 0xa578910534661dca expref: 11 pid: 6680 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788830602.077553:0:6677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257f733100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6677:1875724595168640:192.168.201.21@tcp:104: 00000100:00100000:2.0:1788830602.077621:0:6677:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2548317180 going to sleep for 11 seconds 00000100:00100000:1.0:1788830602.080404:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2566011500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875724595168768:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788830602.080510:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830602.080572:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595168768 00000100:00100000:1.0:1788830602.080581:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595168768 00000100:00100000:1.0:1788830602.080650:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788830602.080660:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2566013100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875724595168768:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788830602.081279:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00002000:00080000:1.0:1788830602.083109:0:6680:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00002000:00010000:1.0:1788830602.083177:0:6680:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a9f6388, atime: 0x6a9f6388, ctime: 0x6a9f6388, blocks: 0xb 00010000:00010000:1.0:1788830602.083191:0:6680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005c92837c/0x575506951eea139a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830602.083214:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=355s v=(0 0) 00010000:00010000:1.0:1788830602.083220:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788830602.083228:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005c92837c/0x575506951eea139a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788830602.083441:0:11161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578381440 00000100:00100000:2.0:1788830602.083453:0:11161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578381440 00010000:00010000:2.0:1788830602.083510:0:11161:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000037589048/0x575506951eea1155 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.21@tcp remote: 0xa578910534661dca expref: 12 pid: 6680 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788830602.083557:0:11161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 56 00000100:00100000:2.0:1788830602.083568:0:11161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2547243b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+12:2355:x1875724578381440:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788830602.083586:0:11161:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788830602.083592:0:11161:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000037589048/0x575506951eea1155 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.21@tcp remote: 0xa578910534661dca expref: 12 pid: 6680 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830602.083607:0:11161:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000037589048/0x575506951eea1155 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.21@tcp remote: 0xa578910534661dca expref: 12 pid: 6680 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830602.083634:0:11161:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788830602.083638:0:11161:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788830602.083643:0:11161:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009f4303fc/0x575506951eea1393 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830602.083651:0:11161:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009f4303fc/0x575506951eea1393 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830602.083676:0:11161:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788830602.083787:0:11161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2547243b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+12:2355:x1875724578381440:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 221us (2511us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830602.083795:0:11161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 56 00010000:00010000:2.0:1788830602.083863:0:6677:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000037589048/0x575506951eea1155 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.21@tcp remote: 0xa578910534661dca expref: 11 pid: 6680 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788830602.084032:0:6677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257f733100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6677:1875724595168640:192.168.201.21@tcp:104: 00010000:00010000:2.0:1788830602.084060:0:6677:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009f4303fc/0x575506951eea1393 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830602.084071:0:6677:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009f4303fc/0x575506951eea1393 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830602.084078:0:6677:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009f4303fc/0x575506951eea1393 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830602.084088:0:6677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009f4303fc/0x575506951eea1393 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830602.084096:0:6677:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009f4303fc/0x575506951eea1393 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830602.084118:0:6677:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788830602.084457:0:6680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005c92837c/0x575506951eea139a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830602.084468:0:6680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005c92837c/0x575506951eea139a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830602.084476:0:6680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005c92837c/0x575506951eea139a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830602.084495:0:6680:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1788830602.087629:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2551309f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3310:x1875724595168512:12345-0@lo:6:osp-syn-0-0.0 Request processed in 10280us (10527us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1788830602.087648:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00010000:2.0:1788830602.087742:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788830602.087752:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009f4303fc/0x575506951eea1393 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830602.087790:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2565729000 already unused, calling callback (ffffffffc14cb350) 00010000:00010000:2.0:1788830602.087795:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009f4303fc/0x575506951eea1393 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830602.087808:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009f4303fc/0x575506951eea1393 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830602.087837:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009f4303fc/0x575506951eea1393 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830602.087845:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009f4303fc/0x575506951eea1393 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830602.091422:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788830602.091443:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005c92837c/0x575506951eea139a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830602.091463:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e25820ff400 already unused, calling callback (ffffffffc14cb350) 00010000:00010000:2.0:1788830602.091469:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005c92837c/0x575506951eea139a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830602.091483:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005c92837c/0x575506951eea139a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830602.091511:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005c92837c/0x575506951eea139a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830602.091531:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005c92837c/0x575506951eea139a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830602.091562:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788830602.091564:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788830602.091567:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788830602.091671:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00010000:00010000:0.0:1788830602.092059:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788830602.092667:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2566013100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3310:x1875724595168768:12345-0@lo:6:osp-syn-1-0.0 Request processed in 12000us (12149us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1788830602.092742:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788830602.092787:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578381568 00000100:00100000:1.0:1788830602.092797:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578381568 00000100:00100000:3.0:1788830602.094487:0:12010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 44 00000100:00100000:3.0:1788830602.094517:0:12010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257f733100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+11:2355:x1875724578381568:12345-192.168.201.21@tcp:16:lhsmtool_posix.0 00000100:00080000:0.0:1788830602.101071:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788830602.103130:0:3310:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:1.0:1788830602.103148:0:3310:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967303 00000004:00080000:1.0:1788830602.103176:0:3310:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e257e924000, transno 4294967301 00000004:00080000:1.0:1788830602.103197:0:3310:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967303 00000100:00100000:1.0:1788830602.103222:0:3310:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9e2566011500 x1875724595168768/t4294967304(4294967304) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788830618 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1788830602.103864:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e2566011500/2, rc 0, transno 4294967304 00000100:00100000:1.0:1788830602.103947:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2566011500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875724595168768:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1788830602.103979:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e255130ad80/2, rc 0, transno 4294967309 00000100:00100000:1.0:1788830602.104009:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e255130ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875724595168512:0@lo:6:osp-syn-0-0.0 00000001:00080000:1.0:1788830602.136308:0:6709:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967307 is committed 00000001:00080000:1.0:1788830602.136330:0:6709:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000001:00080000:1.0:1788830602.136435:0:6709:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000100:00100000:3.0:1788830602.139787:0:12010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257f733100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+8:2355:x1875724578381568:12345-192.168.201.21@tcp:16:lhsmtool_posix.0 Request processed in 42178us (45016us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830602.139811:0:12010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 44 00000100:00100000:2.0:1788830602.140144:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830602.140232:0:8202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578381824 00000100:00100000:0.0:1788830602.140254:0:8202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578381824 00000100:00100000:0.0:1788830602.140330:0:8202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 124 00000100:00100000:0.0:1788830602.140343:0:8202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257f730380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+15:10544:x1875724578381824:12345-192.168.201.21@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788830602.140412:0:8202:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788830602.140467:0:8202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea137e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661e5d expref: 15 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830602.140492:0:8202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9e2551f3e500) 00010000:00010000:0.0:1788830602.140499:0:8202:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788830602.140542:0:8202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea13a1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830602.140560:0:8202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea13a1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830602.140572:0:8202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea13a1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788830602.141424:0:8202:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f2c8573b reply state 00000000922122f1 transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea13a1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788830602.141441:0:8202:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788830602.141742:0:8202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257f730380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+16:10544:x1875724578381824:12345-192.168.201.21@tcp:36:lhsmtool_posix.0 Request processed in 1365us (1561us total) trans 4294967399 rc 0/0 00000100:00100000:0.0:1788830602.141752:0:8202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 124 00000001:00080000:1.0:1788830602.143595:0:6709:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000100:00100000:0.0:1788830602.147509:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830602.148360:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578381952 00000100:00100000:1.0:1788830602.148376:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578381952 00000100:00100000:1.0:1788830602.148456:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 45 00000100:00100000:1.0:1788830602.148470:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2545cbe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+6:2355:x1875724578381952:12345-192.168.201.21@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788830602.148831:0:6679:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1788830602.148835:0:6679:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788830600 00002000:00010000:1.0:1788830602.148837:0:6679:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788830600 00002000:00010000:1.0:1788830602.148840:0:6679:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1788830601 -> 1788830600 00002000:00010000:1.0:1788830602.148842:0:6679:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1788830602.149042:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2545cbe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+7:2355:x1875724578381952:12345-192.168.201.21@tcp:2:lhsmtool_posix.0 Request processed in 574us (1548us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1788830602.149051:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 45 00010000:00010000:3.0:1788830602.151205:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea13a1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830602.151225:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea13a1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830602.151296:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea13a1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830602.151304:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2445b7f800 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:3.0:1788830602.151310:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea13a1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830602.151318:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea13a1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830602.151340:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9e2551f3e500) 00010000:00010000:3.0:1788830602.151344:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788830602.151348:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea13a1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830602.151356:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea13a1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788830602.151679:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830602.151810:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578382208 00000100:00100000:3.0:1788830602.151823:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578382208 00000100:00100000:3.0:1788830602.151888:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 125 00000100:00100000:3.0:1788830602.151899:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257f732300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+15:10544:x1875724578382208:12345-192.168.201.21@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788830602.151985:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945c00/0x575506951eea13a8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830602.152015:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728a00/0x575506951eea1362 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661e4f expref: 15 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830602.152026:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945c00/0x575506951eea13a8 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830602.152069:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728a00/0x575506951eea1362 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.21@tcp remote: 0xa578910534661e4f expref: 15 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830602.152085:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728a00/0x575506951eea1362 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661e4f expref: 15 pid: 5834 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788830602.152101:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2547242680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5834:1875724595168896:192.168.201.21@tcp:104: 00000100:00100000:3.0:1788830602.152620:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e255385d780 going to sleep for 11 seconds 00000100:00100000:2.0:1788830602.156492:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830602.156586:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578382336 00000100:00100000:0.0:1788830602.156599:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578382336 00010000:00010000:0.0:1788830602.156650:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728a00/0x575506951eea1362 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661e4f expref: 16 pid: 5834 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788830602.156728:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 57 00000100:00100000:0.0:1788830602.156740:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257f730000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+16:2355:x1875724578382336:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788830602.156759:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788830602.156786:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728a00/0x575506951eea1362 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661e4f expref: 16 pid: 5834 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830602.156800:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728a00/0x575506951eea1362 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661e4f expref: 16 pid: 5834 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830602.156829:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9e2551f3e500) 00010000:00010000:0.0:1788830602.156835:0:5817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945c00/0x575506951eea13a8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830602.156846:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945c00/0x575506951eea13a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830602.156855:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945c00/0x575506951eea13a8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830602.156884:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788830602.156955:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257f730000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+16:2355:x1875724578382336:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 217us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830602.156963:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 57 00010000:00010000:3.0:1788830602.158764:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728a00/0x575506951eea1362 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661e4f expref: 15 pid: 5834 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788830602.158798:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2547242680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5834:1875724595168896:192.168.201.21@tcp:104: 00010000:00010000:3.0:1788830602.158836:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945c00/0x575506951eea13a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830602.159091:0:5834:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945c00/0x575506951eea13a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830602.159100:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945c00/0x575506951eea13a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830602.159140:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945c00/0x575506951eea13a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830602.159147:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945c00/0x575506951eea13a8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830602.159154:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945c00/0x575506951eea13a8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830602.159161:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e257d945c00 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:2.0:1788830602.159166:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945c00/0x575506951eea13a8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830602.159185:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945c00/0x575506951eea13a8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830602.159205:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9e2551f3e500) 00010000:00010000:2.0:1788830602.159209:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1788830602.159214:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945c00/0x575506951eea13a8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830602.159220:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945c00/0x575506951eea13a8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788830602.159517:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257f732300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+14:10544:x1875724578382208:12345-192.168.201.21@tcp:55:lhsmtool_posix.0 Request processed in 7617us (7842us total) trans 0 rc -22/-22 00000100:00100000:2.0:1788830602.159528:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 125 00000100:00100000:3.0:1788830602.162556:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830602.162936:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578382464 00000100:00100000:1.0:1788830602.162950:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578382464 00000100:00100000:1.0:1788830602.163069:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 46 00000100:00100000:1.0:1788830602.163081:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2547242680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+7:2354:x1875724578382464:12345-192.168.201.21@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788830602.163146:0:6680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000daa146a5/0x575506951eea13af lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830602.163173:0:6680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6244189/0x575506951eea138c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.21@tcp remote: 0xa578910534661e6b expref: 7 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830602.163183:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788830602.163188:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788830602.163193:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000daa146a5/0x575506951eea13af lrc: 4/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830602.163310:0:6680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d6244189/0x575506951eea138c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.21@tcp remote: 0xa578910534661e6b expref: 7 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830602.163328:0:6680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d6244189/0x575506951eea138c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.21@tcp remote: 0xa578910534661e6b expref: 7 pid: 6679 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788830602.163344:0:6680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2566012d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6680:1875724595169024:192.168.201.21@tcp:104: 00000100:00100000:1.0:1788830602.163491:0:6680:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2553863300 going to sleep for 11 seconds 00000100:00100000:0.0:1788830602.167316:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830602.168034:0:11161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578382592 00000100:00100000:2.0:1788830602.168048:0:11161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578382592 00010000:00010000:2.0:1788830602.168105:0:11161:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d6244189/0x575506951eea138c lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.21@tcp remote: 0xa578910534661e6b expref: 8 pid: 6679 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788830602.168160:0:11161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 58 00000100:00100000:2.0:1788830602.168173:0:11161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2545cbea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+8:2355:x1875724578382592:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788830602.168195:0:11161:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788830602.168226:0:11161:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d6244189/0x575506951eea138c lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.21@tcp remote: 0xa578910534661e6b expref: 8 pid: 6679 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830602.168253:0:11161:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d6244189/0x575506951eea138c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.21@tcp remote: 0xa578910534661e6b expref: 8 pid: 6679 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830602.168322:0:11161:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788830602.168328:0:11161:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788830602.168335:0:11161:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000daa146a5/0x575506951eea13af lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830602.168347:0:11161:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000daa146a5/0x575506951eea13af lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830602.168372:0:11161:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788830602.168455:0:11161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2545cbea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+8:2355:x1875724578382592:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 283us (1164us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830602.168463:0:11161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 58 00010000:00010000:1.0:1788830602.170359:0:6680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6244189/0x575506951eea138c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.21@tcp remote: 0xa578910534661e6b expref: 7 pid: 6679 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788830602.170391:0:6680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2566012d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6680:1875724595169024:192.168.201.21@tcp:104: 00010000:00010000:1.0:1788830602.170428:0:6680:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000daa146a5/0x575506951eea13af lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830602.170441:0:6680:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000daa146a5/0x575506951eea13af lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830602.170448:0:6680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000daa146a5/0x575506951eea13af lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830602.170496:0:6680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000daa146a5/0x575506951eea13af lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830602.170506:0:6680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000daa146a5/0x575506951eea13af lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830602.170516:0:6680:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000daa146a5/0x575506951eea13af lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830602.170524:0:6680:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e25820ffa00 already unused, calling callback (ffffffffc14cb350) 00010000:00010000:1.0:1788830602.170529:0:6680:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000daa146a5/0x575506951eea13af lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830602.170566:0:6680:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000daa146a5/0x575506951eea13af lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830602.170588:0:6680:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000daa146a5/0x575506951eea13af lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830602.170597:0:6680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000daa146a5/0x575506951eea13af lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788830602.171088:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2547242680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+6:2354:x1875724578382464:12345-192.168.201.21@tcp:1:lhsmtool_posix.0 Request processed in 8005us (8542us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830602.171102:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 46 00000100:00100000:0.0:1788830602.174320:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830602.174424:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578382848 00000100:00100000:2.0:1788830602.174437:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578382848 00000100:00100000:2.0:1788830602.174544:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 126 00000100:00100000:2.0:1788830602.174557:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2545cbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+14:10544:x1875724578382848:12345-192.168.201.21@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788830602.174679:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729600/0x575506951eea13b6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830602.174843:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729600/0x575506951eea13b6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830602.174861:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729600/0x575506951eea13b6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830602.175150:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728c00/0x575506951eea13bd lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830602.175187:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ec00/0x575506951eea1370 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661e56 expref: 15 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830602.175196:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728c00/0x575506951eea13bd lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830602.175252:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ec00/0x575506951eea1370 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.21@tcp remote: 0xa578910534661e56 expref: 15 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830602.175270:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ec00/0x575506951eea1370 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661e56 expref: 15 pid: 5833 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788830602.175287:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257f733b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5832:1875724595169152:192.168.201.21@tcp:104: 00000100:00100000:2.0:1788830602.175657:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2548317180 going to sleep for 11 seconds 00000100:00100000:3.0:1788830602.180227:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830602.180318:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578382976 00000100:00100000:0.0:1788830602.180332:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578382976 00010000:00010000:0.0:1788830602.180390:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ec00/0x575506951eea1370 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661e56 expref: 16 pid: 5833 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788830602.180435:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 59 00000100:00100000:0.0:1788830602.180445:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2547242300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+16:2355:x1875724578382976:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788830602.180481:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788830602.180489:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ec00/0x575506951eea1370 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661e56 expref: 16 pid: 5833 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830602.180504:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ec00/0x575506951eea1370 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661e56 expref: 16 pid: 5833 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830602.180533:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9e2551f3e500) 00010000:00010000:0.0:1788830602.180539:0:5817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728c00/0x575506951eea13bd lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830602.180550:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728c00/0x575506951eea13bd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830602.180559:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728c00/0x575506951eea13bd lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830602.180580:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788830602.180736:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ec00/0x575506951eea1370 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661e56 expref: 16 pid: 5833 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788830602.180755:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257f733b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5832:1875724595169152:192.168.201.21@tcp:104: 00010000:00010000:1.0:1788830602.180781:0:5832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728c00/0x575506951eea13bd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830602.180791:0:5832:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728c00/0x575506951eea13bd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830602.180798:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728c00/0x575506951eea13bd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788830602.181076:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967400 00000001:00080000:1.0:1788830602.181258:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967401 00000001:00080000:1.0:1788830602.181308:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000100:00100000:1.0:1788830602.181407:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2566012d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5832:1875724595169280:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788830602.181472:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830602.181511:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2549c80780 going to sleep for 11 seconds 00000100:00100000:1.0:1788830602.181542:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595169280 00000100:00100000:1.0:1788830602.181548:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595169280 00000100:00100000:1.0:1788830602.181595:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788830602.181604:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25658e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5832:x1875724595169280:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788830602.181686:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25658e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5832:x1875724595169280:12345-0@lo:1000:mdt00_000.0 Request processed in 83us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830602.181694:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788830602.181788:0:5832:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:1.0:1788830602.181795:0:5832:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967309 00000004:00080000:1.0:1788830602.181815:0:5832:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e255130ad80, transno 4294967309 00000100:00100000:1.0:1788830602.181829:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2566012d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5832:1875724595169280:0@lo:1000:mdt00_000.0 00000001:00080000:1.0:1788830602.182340:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000100:00100000:1.0:1788830602.182401:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25658e2680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5832:1875724595169408:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788830602.182457:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830602.182479:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2549c809c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788830602.182690:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595169408 00000100:00100000:1.0:1788830602.182697:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595169408 00000100:00100000:1.0:1788830602.182766:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788830602.182774:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2566012d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5832:x1875724595169408:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788830602.182953:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2566012d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5832:x1875724595169408:12345-0@lo:1000:mdt00_000.0 Request processed in 179us (496us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1788830602.182960:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788830602.183032:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25658e2680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5832:1875724595169408:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1788830602.183069:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728c00/0x575506951eea13bd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830602.183080:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728c00/0x575506951eea13bd lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830602.183089:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728c00/0x575506951eea13bd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830602.183096:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2565728c00 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:1.0:1788830602.183103:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728c00/0x575506951eea13bd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830602.183111:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728c00/0x575506951eea13bd lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830602.183132:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9e2551f3e500) 00010000:00010000:1.0:1788830602.183135:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788830602.183141:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728c00/0x575506951eea13bd lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830602.183148:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728c00/0x575506951eea13bd lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830602.183182:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e400/0x575506951eea1300 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830602.183188:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e400/0x575506951eea1300 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830602.183193:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e400/0x575506951eea1300 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830602.183204:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2445b7e400 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:1.0:1788830602.183207:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e400/0x575506951eea1300 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830602.183213:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e400/0x575506951eea1300 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830602.183222:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e257480c300) 00010000:00010000:1.0:1788830602.183224:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788830602.183231:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944400/0x575506951eea1307 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661e3a expref: 19 pid: 8202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830602.183242:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944400/0x575506951eea1307 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661e3a expref: 19 pid: 8202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830602.183252:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944400/0x575506951eea1307 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661e3a expref: 19 pid: 8202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830602.183280:0:5832:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944400/0x575506951eea1307 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661e3a expref: 19 pid: 8202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788830602.183291:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e255130ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5832:1875724595169536:192.168.201.21@tcp:105: 00000100:00100000:0.0:1788830602.184095:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2547242300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+19:2355:x1875724578382976:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 3641us (3874us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830602.184109:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 59 00000100:00100000:1.0:1788830602.184201:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2553863300 going to sleep for 11 seconds 00000100:00100000:3.0:1788830602.187622:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830602.187775:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e255130ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5832:1875724595169536:192.168.201.21@tcp:105: 00010000:00010000:1.0:1788830602.187816:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e400/0x575506951eea1300 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830602.187846:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e400/0x575506951eea1300 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830602.187900:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffa00/0x575506951eea13c4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830602.187919:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffa00/0x575506951eea13c4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830602.187933:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffa00/0x575506951eea13c4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830602.187946:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffa00/0x575506951eea13c4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830602.187952:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffa00/0x575506951eea13c4 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830602.187958:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffa00/0x575506951eea13c4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830602.187966:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e25820ffa00 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:1.0:1788830602.187970:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffa00/0x575506951eea13c4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830602.187978:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffa00/0x575506951eea13c4 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830602.187991:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e257480c300) 00010000:00010000:1.0:1788830602.188025:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788830602.188031:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffa00/0x575506951eea13c4 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830602.188043:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffa00/0x575506951eea13c4 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830602.188057:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729600/0x575506951eea13b6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830602.188064:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729600/0x575506951eea13b6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830602.188070:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729600/0x575506951eea13b6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830602.188075:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2565729600 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:1.0:1788830602.188078:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729600/0x575506951eea13b6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830602.188084:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729600/0x575506951eea13b6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830602.188093:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e257480c300) 00010000:00010000:1.0:1788830602.188096:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788830602.188099:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729600/0x575506951eea13b6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830602.188105:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729600/0x575506951eea13b6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788830602.188619:0:11676:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788830602.188626:0:11676:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788830602.189469:0:11676:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1788830602.189482:0:11676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788830602.189630:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2545cbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+18:10544:x1875724578382848:12345-192.168.201.21@tcp:57:lhsmtool_posix.0 Request processed in 15070us (15320us total) trans 4294967404 rc 0/0 00000100:00100000:1.0:1788830602.189644:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 126 00000020:00080000:1.0:1788830602.189651:0:5832:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:2.0:1788830602.189799:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578383104 00000100:00100000:2.0:1788830602.189810:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578383104 00000100:00100000:2.0:1788830602.189941:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 30 00000100:00100000:2.0:1788830602.189955:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e244599a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+18:10543:x1875724578383104:12345-192.168.201.21@tcp:49:lfs.0 00000100:00100000:2.0:1788830602.190091:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e244599a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+18:10543:x1875724578383104:12345-192.168.201.21@tcp:49:lfs.0 Request processed in 139us (2483us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830602.190098:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 30 00000100:00100000:2.0:1788830602.194637:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830602.195775:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578383360 00000100:00100000:3.0:1788830602.195793:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578383360 00000100:00100000:3.0:1788830602.195867:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 127 00000100:00100000:3.0:1788830602.195938:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257f731c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+18:10543:x1875724578383360:12345-192.168.201.21@tcp:58:lfs.0 00000100:00100000:2.0:1788830602.197056:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830602.197140:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578383616 00000100:00100000:0.0:1788830602.197149:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578383616 00000100:00100000:0.0:1788830602.197204:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 31 00000100:00100000:0.0:1788830602.197214:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257f731500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+19:10544:x1875724578383616:12345-192.168.201.21@tcp:35:lhsmtool_posix.0 00000040:00080000:3.0:1788830602.198479:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:3.0:1788830602.198612:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257f731c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+20:10543:x1875724578383360:12345-192.168.201.21@tcp:58:lfs.0 Request processed in 2673us (3984us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830602.198623:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 127 00000004:00080000:0.0:1788830602.206204:0:5836:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788830602.207957:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00010000:00010000:0.0:1788830602.208086:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea13cb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830602.208117:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea13cb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830602.208131:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea13cb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830602.208142:0:5836:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea13cb lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830602.208149:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea13cb lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830602.208155:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea13cb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830602.208183:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788830602.208505:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788830602.208514:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea13cb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830602.208533:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2445b7f800 already unused, calling callback (ffffffffc14cb350) 00010000:00010000:2.0:1788830602.208538:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea13cb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830602.208546:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea13cb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830602.208562:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9e25518dcf00) 00010000:00010000:2.0:1788830602.208565:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788830602.208570:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea13cb lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830602.208577:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea13cb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830602.208596:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788830602.208597:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788830602.208599:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788830602.209029:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257f731500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+20:10544:x1875724578383616:12345-192.168.201.21@tcp:35:lhsmtool_posix.0 Request processed in 11809us (11973us total) trans 4294967406 rc 0/0 00000100:00100000:0.0:1788830602.209042:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 31 00000020:00080000:0.0:1788830602.209048:0:5836:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788830602.236603:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830602.236754:0:8202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578383744 00000100:00100000:0.0:1788830602.236768:0:8202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578383744 00000100:00100000:0.0:1788830602.236848:0:8202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 128 00000100:00100000:0.0:1788830602.236860:0:8202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257f732680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+20:10546:x1875724578383744:12345-192.168.201.21@tcp:101:lfs.0 00010000:00010000:0.0:1788830602.236905:0:8202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788830602.236934:0:8202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e200/0x575506951eea13d2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa578910534661e72 expref: -99 pid: 8202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830602.237043:0:8202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea13d9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830602.237082:0:8202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea13d9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830602.237097:0:8202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea13d9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830602.237114:0:8202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e400/0x575506951eea13e0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830602.237122:0:8202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e400/0x575506951eea13e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830602.237129:0:8202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e400/0x575506951eea13e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830602.237427:0:8202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ec00/0x575506951eea13e7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830602.237440:0:8202:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f000/0x575506951eea12f2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661e33 expref: 21 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830602.237450:0:8202:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ec00/0x575506951eea13e7 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830602.237493:0:8202:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f000/0x575506951eea12f2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.21@tcp remote: 0xa578910534661e33 expref: 21 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830602.237510:0:8202:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f000/0x575506951eea12f2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661e33 expref: 21 pid: 5832 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788830602.237539:0:8202:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2545cbed80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8202:1875724595169664:192.168.201.21@tcp:104: 00000100:00100000:0.0:1788830602.237669:0:8202:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2550b87240 going to sleep for 11 seconds 00000100:00100000:2.0:1788830602.242278:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830602.242448:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578384000 00000100:00100000:1.0:1788830602.242462:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578384000 00000100:00100000:1.0:1788830602.242538:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 32 00000100:00100000:1.0:1788830602.242551:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25629b3c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+22:5589:x1875724578384000:12345-192.168.201.21@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788830602.242926:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25629b3c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+23:5589:x1875724578384000:12345-192.168.201.21@tcp:35:ldlm_bl.0 Request processed in 376us (662us total) trans 4294967407 rc 0/0 00000100:00100000:1.0:1788830602.242935:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 32 00000100:00100000:3.0:1788830602.245814:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830602.246072:0:8202:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2545cbed80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8202:1875724595169664:192.168.201.21@tcp:104: 00010000:00010000:0.0:1788830602.246111:0:8202:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ec00/0x575506951eea13e7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788830602.246245:0:11161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578384128 00000100:00100000:1.0:1788830602.246254:0:11161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578384128 00010000:00010000:1.0:1788830602.246422:0:11161:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f000/0x575506951eea12f2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661e33 expref: 23 pid: 5832 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788830602.246468:0:11161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 60 00000100:00100000:1.0:1788830602.246479:0:11161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255da69050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+23:2355:x1875724578384128:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788830602.246500:0:11161:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788830602.246508:0:11161:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f000/0x575506951eea12f2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661e33 expref: 23 pid: 5832 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830602.246521:0:11161:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f000/0x575506951eea12f2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661e33 expref: 23 pid: 5832 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830602.246551:0:11161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f000/0x575506951eea12f2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661e33 expref: 23 pid: 5832 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830602.246595:0:11161:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e257480c300) 00010000:00010000:1.0:1788830602.246601:0:11161:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ec00/0x575506951eea13e7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830602.246613:0:11161:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ec00/0x575506951eea13e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830602.246622:0:11161:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ec00/0x575506951eea13e7 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830602.246659:0:11161:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788830602.246786:0:11161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255da69050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+22:2355:x1875724578384128:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 309us (986us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830602.246795:0:11161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 60 00010000:00010000:3.0:1788830602.246963:0:8202:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ec00/0x575506951eea13e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830602.246972:0:8202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ec00/0x575506951eea13e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788830602.247038:0:8202:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1788830602.247044:0:8202:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788830602.247069:0:8202:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ec00/0x575506951eea13e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830602.247085:0:8202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ec00/0x575506951eea13e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830602.247097:0:8202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea13d9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830602.247117:0:8202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea13d9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830602.247123:0:8202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea13d9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830602.247130:0:8202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2445b7f800 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:3.0:1788830602.247135:0:8202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea13d9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830602.247143:0:8202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea13d9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830602.247153:0:8202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e25518dc500) 00010000:00010000:3.0:1788830602.247156:0:8202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788830602.247160:0:8202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea13d9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830602.247165:0:8202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea13d9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830602.247177:0:8202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e400/0x575506951eea13e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830602.247183:0:8202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e400/0x575506951eea13e0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830602.247188:0:8202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e400/0x575506951eea13e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830602.247193:0:8202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2445b7e400 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:3.0:1788830602.247202:0:8202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e400/0x575506951eea13e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830602.247208:0:8202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e400/0x575506951eea13e0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830602.247216:0:8202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9e25518dcb00) 00010000:00010000:3.0:1788830602.247218:0:8202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788830602.247221:0:8202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e400/0x575506951eea13e0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830602.247227:0:8202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e400/0x575506951eea13e0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830602.247282:0:8202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e200/0x575506951eea13d2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661e72 expref: 22 pid: 8202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830602.247494:0:8202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ec00/0x575506951eea13e7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661e72 expref: 21 pid: 8202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830602.247504:0:8202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e257480c300) 00010000:00010000:3.0:1788830602.247507:0:8202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788830602.247509:0:8202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2445b7ec00, rc 0) 00000100:00100000:3.0:1788830602.247550:0:8202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257f732680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+21:10546:x1875724578383744:12345-192.168.201.21@tcp:101:lfs.0 Request processed in 10693us (10964us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830602.247558:0:8202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 128 00010000:00010000:0.0:1788830602.267981:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788830602.638458:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830602.638517:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830602.638545:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830602.638567:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830602.638632:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578384384 00000100:00100000:0.0:1788830602.638645:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578384384 00000100:00100000:0.0:1788830602.638729:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578384512 00000100:00100000:0.0:1788830602.638732:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578384512 00000100:00100000:0.0:1788830602.638768:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 73 00000100:00100000:0.0:1788830602.638780:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e244599bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+6:2353:x1875724578384384:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:0.0:1788830602.638867:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e244599bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+6:2353:x1875724578384384:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 89us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830602.638875:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 73 00000100:00100000:0.0:1788830602.638895:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 74 00000100:00100000:0.0:1788830602.638902:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e244599b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+5:2352:x1875724578384512:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:0.0:1788830602.638928:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e244599b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+5:2352:x1875724578384512:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 27us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830602.638932:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 74 00000100:00100000:0.0:1788830602.638949:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578384640 00000100:00100000:0.0:1788830602.638951:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578384640 00000100:00100000:0.0:1788830602.638976:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 123 00000100:00100000:0.0:1788830602.638980:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e244599a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2154ea6-69cb-4a30-aac0-000fba13e98b+5:2353:x1875724578384640:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:0.0:1788830602.639035:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e244599a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2154ea6-69cb-4a30-aac0-000fba13e98b+5:2353:x1875724578384640:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 53us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830602.639042:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 123 00000100:00080000:0.0:1788830602.639059:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788830602.639064:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788830602.639693:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578384256 00000100:00100000:1.0:1788830602.639703:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578384256 00000100:00100000:1.0:1788830602.639770:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 285 00000100:00100000:1.0:1788830602.639780:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2574710c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+13:2352:x1875724578384256:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:1.0:1788830602.639834:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2574710c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+13:2352:x1875724578384256:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 57us (1316us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830602.639841:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 285 00000100:00100000:0.0:1788830602.979880:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e255130ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1745cc3d-3952-4cd4-9020-9b8acb483105:3307:1875724595169792:0@lo:400:kworker.0 00000100:00100000:1.0:1788830602.979906:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2547242300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875724595170048:0@lo:400:kworker.0 00000100:00100000:1.0:1788830602.982730:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830602.982844:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788830602.982861:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25478b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875724595170176:0@lo:400:kworker.0 00000100:00100000:0.0:1788830602.982885:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830602.982915:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830602.982969:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595170048 00000100:00100000:3.0:1788830602.982995:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595170048 00000100:00100000:0.0:1788830602.983002:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2565433800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1875724595170304:0@lo:400:kworker.0 00000100:00100000:1.0:1788830602.983003:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595170176 00000100:00100000:1.0:1788830602.983012:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595170176 00000100:00100000:0.0:1788830602.983061:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830602.983092:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788830602.983103:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788830602.983108:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595170304 00000100:00100000:3.0:1788830602.983111:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2565cc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3309:x1875724595170048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788830602.983114:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595170304 00000100:00100000:0.0:1788830602.983117:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2547243b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875724595169920:0@lo:400:kworker.0 00000100:00100000:1.0:1788830602.983149:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1788830602.983164:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2565cc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875724595170176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788830602.983166:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830602.983191:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2565cc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875724595170432:0@lo:400:kworker.0 00000100:00100000:0.0:1788830602.983475:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788830602.983908:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595169792 00000100:00100000:2.0:1788830602.983915:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595169792 00000100:00100000:2.0:1788830602.983958:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:2.0:1788830602.983967:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2574712050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+19:3307:x1875724595169792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788830602.984035:0:8202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595169920 00000100:00100000:0.0:1788830602.984039:0:8202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595169920 00000100:00100000:0.0:1788830602.984201:0:8202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1788830602.984209:0:8202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2545cbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875724595170304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788830602.984272:0:8202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2545cbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875724595170304:12345-0@lo:400:kworker.0 Request processed in 63us (1223us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830602.985590:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2565cc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875724595170176:12345-0@lo:400:kworker.0 Request processed in 2423us (2666us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830602.985605:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1788830602.985649:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1788830602.985664:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2545cbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875724595169920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788830602.985723:0:8202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1788830602.985752:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2545cbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875724595169920:12345-0@lo:400:kworker.0 Request processed in 95us (2591us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830602.985760:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00080000:1.0:1788830602.985787:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788830602.985803:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2547243b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875724595169920:0@lo:400:kworker.0 00000100:00100000:0.0:1788830602.985826:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2565433800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1875724595170304:0@lo:400:kworker.0 00000100:00100000:1.0:1788830602.985829:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595170432 00000100:00100000:1.0:1788830602.985845:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595170432 00000100:00100000:1.0:1788830602.985889:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788830602.985898:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2545cbea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3307:x1875724595170432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788830602.985943:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2545cbea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3307:x1875724595170432:12345-0@lo:400:kworker.0 Request processed in 46us (2468us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830602.985951:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788830602.985966:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2565cc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875724595170432:0@lo:400:kworker.0 00000100:00100000:1.0:1788830602.986003:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25478b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875724595170176:0@lo:400:kworker.0 00000100:00100000:3.0:1788830602.986123:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2565cc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3309:x1875724595170048:12345-0@lo:400:kworker.0 Request processed in 3013us (3412us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830602.986208:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788830602.986547:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2547242300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875724595170048:0@lo:400:kworker.0 00000100:00100000:2.0:1788830602.986784:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2574712050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+19:3307:x1875724595169792:12345-0@lo:400:kworker.0 Request processed in 2817us (3899us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830602.986795:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:3.0:1788830602.987105:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e255130ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1745cc3d-3952-4cd4-9020-9b8acb483105:3307:1875724595169792:0@lo:400:kworker.0 00000040:00080000:2.0:1788830603.009825:0:12100:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788830603.009839:0:12100:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788830603.009920:0:12100:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1788830603.009928:0:12100:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1788830603.228262:0:11676:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788830603.228273:0:11676:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788830603.228332:0:11676:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1788830603.228342:0:11676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788830603.228478:0:11676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2565cc0e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11676:1875724595170560:192.168.201.21@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788830603.228592:0:11676:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e257f729c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788830603.233197:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830603.233442:0:11676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2565cc0e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11676:1875724595170560:192.168.201.21@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788830603.234281:0:8202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578384768 00000100:00100000:3.0:1788830603.234292:0:8202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578384768 00000100:00100000:3.0:1788830603.234407:0:8202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 129 00000100:00100000:3.0:1788830603.234418:0:8202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2565433800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+21:10558:x1875724578384768:12345-192.168.201.21@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788830603.234456:0:8202:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788830603.234584:0:8202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2565433800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+21:10558:x1875724578384768:12345-192.168.201.21@tcp:53:lhsmtool_posix.0 Request processed in 166us (1396us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830603.234594:0:8202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 129 00000100:00100000:3.0:1788830603.241885:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830603.242194:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578385024 00000100:00100000:1.0:1788830603.242209:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578385024 00000100:00100000:1.0:1788830603.242362:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 130 00000100:00100000:1.0:1788830603.242374:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e244599a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+21:10558:x1875724578385024:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788830603.242397:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788830603.242420:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff400/0x575506951eea13ee lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa578910534661e79 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830603.244396:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffe00/0x575506951eea13f5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830603.244421:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffe00/0x575506951eea13f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830603.244435:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffe00/0x575506951eea13f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788830603.244449:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1788830603.245394:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff400/0x575506951eea13ee lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661e79 expref: 24 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830603.245420:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffe00/0x575506951eea13f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661e79 expref: 23 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830603.245430:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e257480c300) 00010000:00010000:1.0:1788830603.245447:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788830603.245450:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e25820ffe00, rc 0) 00000100:00100000:1.0:1788830603.245535:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e244599a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+23:10558:x1875724578385024:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 Request processed in 3163us (3664us total) trans 4294967408 rc 0/0 00000100:00100000:1.0:1788830603.245544:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 130 00000100:00100000:2.0:1788830603.249415:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830603.249772:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578385280 00000100:00100000:1.0:1788830603.249787:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578385280 00000100:00100000:1.0:1788830603.249859:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 131 00000100:00100000:1.0:1788830603.249871:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257f730e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+23:10558:x1875724578385280:12345-192.168.201.21@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788830603.249988:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe800/0x575506951eea1403 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830603.250007:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe800/0x575506951eea1403 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830603.250019:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe800/0x575506951eea1403 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830603.250243:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe800/0x575506951eea1403 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830603.250252:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe800/0x575506951eea1403 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830603.250260:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe800/0x575506951eea1403 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830603.250267:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e25820fe800 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:1.0:1788830603.250272:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe800/0x575506951eea1403 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830603.250301:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe800/0x575506951eea1403 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830603.250316:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e257480c300) 00010000:00010000:1.0:1788830603.250319:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788830603.250324:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe800/0x575506951eea1403 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830603.250330:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe800/0x575506951eea1403 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788830603.250379:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830603.250763:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257f730e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+24:10558:x1875724578385280:12345-192.168.201.21@tcp:57:lhsmtool_posix.0 Request processed in 890us (1359us total) trans 4294967409 rc 0/0 00000100:00100000:1.0:1788830603.250772:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 131 00000040:00080000:3.0:1788830603.250913:0:11676:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788830603.250919:0:11676:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788830603.251700:0:11676:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1788830603.251757:0:11676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788830603.254188:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830603.254208:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578385408 00000100:00100000:3.0:1788830603.254275:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578385664 00000100:00100000:3.0:1788830603.254381:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578385664 00000100:00100000:3.0:1788830603.254470:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 33 00000100:00100000:3.0:1788830603.254486:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2565cc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+24:10558:x1875724578385664:12345-192.168.201.21@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788830603.254768:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578385408 00000100:00100000:2.0:1788830603.254837:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 9 00000100:00100000:2.0:1788830603.254847:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255130ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+25:2354:x1875724578385408:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788830603.255153:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788830603.255186:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffe00/0x575506951eea13f5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661e79 expref: 26 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830603.255211:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e257480c300) 00010000:00010000:2.0:1788830603.255216:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788830603.255460:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255130ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+25:2354:x1875724578385408:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 614us (5085us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830603.255470:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 9 00000100:00100000:3.0:1788830603.255535:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2565cc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+24:10558:x1875724578385664:12345-192.168.201.21@tcp:35:lhsmtool_posix.0 Request processed in 1053us (1360us total) trans 4294967410 rc 0/0 00000100:00100000:3.0:1788830603.255543:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 33 00010000:00010000:2.0:1788830603.291921:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788830603.484278:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788830603.484801:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257f731f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875724595170688:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788830603.484911:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830603.486331:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595170688 00000100:00100000:3.0:1788830603.486349:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595170688 00000100:00100000:3.0:1788830603.486435:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788830603.486447:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2547242300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1875724595170688:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788830603.486491:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788830603.486602:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2547242300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1875724595170688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 156us (1691us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830603.486609:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788830603.487916:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257f731f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875724595170688:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788830604.319653:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788830604.979495:0:12151:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788830604.979508:0:12151:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788830604.979561:0:12151:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1788830604.979569:0:12151:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788830605.172701:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830605.172786:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578385920 00000100:00100000:1.0:1788830605.172801:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578385920 00000100:00100000:1.0:1788830605.172907:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 132 00000100:00100000:1.0:1788830605.172920:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2547243b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+24:10578:x1875724578385920:12345-192.168.201.21@tcp:101:lfs.0 00010000:00010000:1.0:1788830605.172966:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788830605.172994:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe800/0x575506951eea140a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa578910534661e80 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830605.173138:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffe00/0x575506951eea1411 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830605.173172:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffe00/0x575506951eea1411 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830605.173189:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffe00/0x575506951eea1411 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788830605.173204:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000100:00080000:0.0:1788830605.173208:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788830605.173380:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe800/0x575506951eea140a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661e80 expref: 27 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830605.173397:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffe00/0x575506951eea1411 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661e80 expref: 26 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830605.173406:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e257480c300) 00010000:00010000:1.0:1788830605.173410:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788830605.173414:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e25820ffe00, rc 0) 00000100:00100000:1.0:1788830605.173496:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2547243b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+26:10578:x1875724578385920:12345-192.168.201.21@tcp:101:lfs.0 Request processed in 579us (809us total) trans 4294967411 rc 0/0 00000100:00100000:1.0:1788830605.173505:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 132 00000100:00100000:0.0:1788830605.179314:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830605.179844:0:8202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578386048 00000100:00100000:3.0:1788830605.179869:0:8202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578386048 00000100:00100000:3.0:1788830605.180069:0:8202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 133 00000100:00100000:3.0:1788830605.180082:0:8202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25658df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+26:10578:x1875724578386048:12345-192.168.201.21@tcp:54:lfs.0 00010000:00010000:3.0:1788830605.180175:0:8202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944800/0x575506951eea141f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830605.180196:0:8202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944800/0x575506951eea141f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830605.180209:0:8202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944800/0x575506951eea141f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830605.180241:0:8202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944800/0x575506951eea141f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830605.180248:0:8202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944800/0x575506951eea141f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830605.180267:0:8202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944800/0x575506951eea141f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830605.180273:0:8202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e257d944800 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:3.0:1788830605.180278:0:8202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944800/0x575506951eea141f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830605.180286:0:8202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944800/0x575506951eea141f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830605.180300:0:8202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e257480c300) 00010000:00010000:3.0:1788830605.180303:0:8202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788830605.180308:0:8202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944800/0x575506951eea141f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830605.180315:0:8202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944800/0x575506951eea141f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788830605.180425:0:8202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25658df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+26:10578:x1875724578386048:12345-192.168.201.21@tcp:54:lfs.0 Request processed in 345us (1126us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830605.180433:0:8202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 133 00000100:00100000:0.0:1788830605.295025:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830605.295209:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578386176 00000100:00100000:1.0:1788830605.295222:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578386176 00000100:00100000:1.0:1788830605.295307:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 47 00000100:00100000:1.0:1788830605.295318:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25658dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+6:2354:x1875724578386176:12345-192.168.201.21@tcp:101:cat.0 00010000:00010000:1.0:1788830605.295339:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788830605.295365:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000d1128c3/0x575506951eea1426 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa578910534661e87 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788830605.295424:0:6680:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a9f6388, atime: 0x6a9f6388, ctime: 0x6a9f6388, blocks: 0xb 00010000:00010000:1.0:1788830605.295450:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=358s v=(0 0) 00010000:00010000:1.0:1788830605.295456:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788830605.295466:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000d1128c3/0x575506951eea1426 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661e87 expref: 7 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830605.295490:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000d1128c3/0x575506951eea1426 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661e87 expref: 7 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830605.295505:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e25820fe800, rc 0) 00000100:00100000:1.0:1788830605.295584:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25658dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+7:2354:x1875724578386176:12345-192.168.201.21@tcp:101:cat.0 Request processed in 268us (577us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830605.295592:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 47 00000100:00080000:0.0:1788830605.296028:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788830605.304385:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830605.304841:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578386304 00000100:00100000:1.0:1788830605.304855:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578386304 00002000:00100000:1.0:1788830605.304920:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff9e257f733480 x1875724578386304/t0(0) o3->1ef2fe7a-e5ec-4085-8326-b72aa00876cd@192.168.201.21@tcp:56/0 lens 488/0 e 0 to 0 dl 1788830616 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788830605.304934:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e257f733480 with x1875724578386304 ext(0->4095) 00002000:00010000:1.0:1788830605.304941:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e257f733480 00000100:00100000:1.0:1788830605.304988:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 3 00000100:00100000:1.0:1788830605.304998:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257f733480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+7:2353:x1875724578386304:12345-192.168.201.21@tcp:3:cat.0 00000100:00100000:1.0:1788830605.305267:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257f733480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+7:2353:x1875724578386304:12345-192.168.201.21@tcp:3:cat.0 Request processed in 269us (896us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1788830605.305293:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 3 00002000:00100000:1.0:1788830605.305301:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff9e257f733480 x1875724578386304/t0(0) o3->1ef2fe7a-e5ec-4085-8326-b72aa00876cd@192.168.201.21@tcp:56/0 lens 488/4536 e 0 to 0 dl 1788830616 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788830605.305309:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e257f733480 with x1875724578386304 ext(0->4095) 00002000:00010000:1.0:1788830605.305313:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e257f733480 00010000:00010000:2.0:1788830605.340155:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788830606.364100:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788830606.603822:0:7646:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000004:00080000:2.0:1788830607.070640:0:6697:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 360417915228ns, next at 361417912873ns, rc = 0 00000100:00100000:0.0:1788830607.070747:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257f730a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875724595170816:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788830607.070839:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788830607.071319:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595170816 00000100:00100000:2.0:1788830607.071329:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595170816 00000100:00100000:2.0:1788830607.071398:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788830607.071408:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25658de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1875724595170816:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788830607.071520:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:2.0:1788830607.071592:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788830607.071668:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25658de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1875724595170816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 261us (828us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830607.071691:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788830607.071824:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257f730a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875724595170816:0@lo:13:osp-pre-0-0.0 00000001:00080000:3.0:1788830607.177212:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967406 is committed 00000001:00080000:3.0:1788830607.177232:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967411 is committed 00000020:00080000:3.0:1788830607.177255:0:5855:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9e2549c80780 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:3.0:1788830607.177269:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9e2444875600 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9e2549c80600 00000020:00080000:3.0:1788830607.177273:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9e2444875b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9e2565b51400 00000020:00080000:3.0:1788830607.177304:0:5855:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:1.0:1788830607.177306:0:5866:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 1 00000020:00080000:1.0:1788830607.177505:0:5866:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00010000:00010000:2.0:1788830607.394416:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788830607.627576:0:6709:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000001:00080000:1.0:1788830607.627592:0:6709:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000100:00100000:0.0:1788830607.765469:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830607.765540:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830607.765572:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830607.765595:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830607.765617:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830607.765644:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578386944 00000100:00100000:0.0:1788830607.765654:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578386944 00000100:00100000:0.0:1788830607.765735:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578386560 00000100:00100000:0.0:1788830607.765739:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578386560 00000100:00100000:0.0:1788830607.765765:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 127 00000100:00100000:0.0:1788830607.765774:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25658dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2154ea6-69cb-4a30-aac0-000fba13e98b+5:2353:x1875724578386944:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:0.0:1788830607.765870:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25658dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2154ea6-69cb-4a30-aac0-000fba13e98b+5:2353:x1875724578386944:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 97us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830607.765879:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 127 00000100:00100000:0.0:1788830607.765897:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 128 00000100:00100000:0.0:1788830607.765913:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25658ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+13:2353:x1875724578386560:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:0.0:1788830607.765940:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25658ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+13:2353:x1875724578386560:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 28us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830607.765946:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 128 00000100:00080000:0.0:1788830607.765966:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788830607.766265:0:12010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578386688 00000100:00100000:3.0:1788830607.766279:0:12010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578386688 00000100:00100000:3.0:1788830607.766329:0:12010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578386816 00000100:00100000:3.0:1788830607.766333:0:12010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578386816 00000100:00100000:3.0:1788830607.766355:0:12010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 77 00000100:00100000:3.0:1788830607.766362:0:12010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25658dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+6:2353:x1875724578386688:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:3.0:1788830607.766399:0:12010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25658dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+6:2353:x1875724578386688:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 38us (858us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830607.766405:0:12010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 77 00000100:00100000:3.0:1788830607.766418:0:12010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 78 00000100:00100000:3.0:1788830607.766425:0:12010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25658dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+5:2353:x1875724578386816:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:3.0:1788830607.766448:0:12010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25658dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+5:2353:x1875724578386816:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 24us (830us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830607.766454:0:12010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 78 00000100:00080000:0.0:1788830607.767815:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788830607.767822:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788830607.771203:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578386432 00000100:00100000:1.0:1788830607.771217:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578386432 00000100:00100000:1.0:1788830607.772148:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 287 00000100:00100000:1.0:1788830607.772161:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2574711850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+13:2353:x1875724578386432:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:1.0:1788830607.772241:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2574711850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+13:2353:x1875724578386432:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 84us (6779us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830607.772327:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 287 00000100:00100000:2.0:1788830608.092024:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25747c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875724595171072:0@lo:400:kworker.0 00000100:00100000:2.0:1788830608.092094:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788830608.092146:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257f805180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875724595171584:0@lo:400:kworker.0 00000100:00100000:2.0:1788830608.092170:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788830608.092201:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788830608.092208:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25478b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1745cc3d-3952-4cd4-9020-9b8acb483105:3308:1875724595170944:0@lo:400:kworker.0 00000100:00100000:2.0:1788830608.092265:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788830608.092285:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25747c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1875724595171456:0@lo:400:kworker.0 00000100:00100000:2.0:1788830608.092309:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788830608.092338:0:12010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595171584 00000100:00100000:2.0:1788830608.092346:0:12010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595171584 00000100:00100000:2.0:1788830608.092408:0:12010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788830608.092419:0:12010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257f732d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875724595171584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788830608.092481:0:12010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257f732d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875724595171584:12345-0@lo:400:kworker.0 Request processed in 63us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830608.092488:0:12010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788830608.092511:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595170944 00000100:00100000:2.0:1788830608.092515:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595170944 00000100:00100000:2.0:1788830608.092541:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:2.0:1788830608.092547:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2574713050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+19:3308:x1875724595170944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788830608.092586:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2574713050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+19:3308:x1875724595170944:12345-0@lo:400:kworker.0 Request processed in 39us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830608.092593:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:2.0:1788830608.092674:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25478b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1745cc3d-3952-4cd4-9020-9b8acb483105:3308:1875724595170944:0@lo:400:kworker.0 00000100:00100000:2.0:1788830608.092687:0:3308:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:2.0:1788830608.092692:0:3308:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e2566011500, transno 4294967304 00000100:00100000:2.0:1788830608.092702:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257f805180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875724595171584:0@lo:400:kworker.0 00000100:00100000:1.0:1788830608.093640:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595171072 00000100:00100000:1.0:1788830608.093649:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595171072 00000100:00100000:1.0:1788830608.093685:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595171456 00000100:00100000:1.0:1788830608.093688:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595171456 00000100:00100000:1.0:1788830608.093727:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788830608.093736:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257f732a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875724595171072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788830608.093793:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257f732a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875724595171072:12345-0@lo:400:kworker.0 Request processed in 58us (1698us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830608.093800:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788830608.093824:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1788830608.093830:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257f733800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875724595171456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788830608.093861:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257f733800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875724595171456:12345-0@lo:400:kworker.0 Request processed in 31us (1552us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830608.093867:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1788830608.094186:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25747c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875724595171200:0@lo:400:kworker.0 00000100:00100000:0.0:1788830608.094224:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830608.094424:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788830608.094432:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25747c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875724595171328:0@lo:400:kworker.0 00000100:00100000:0.0:1788830608.094460:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830608.094495:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595171328 00000100:00100000:0.0:1788830608.094501:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595171328 00000100:00100000:0.0:1788830608.094545:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788830608.094662:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25658dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875724595171328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788830608.094702:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25658dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875724595171328:12345-0@lo:400:kworker.0 Request processed in 151us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830608.094733:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00080000:0.0:1788830608.094752:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788830608.094756:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788830608.094809:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25747c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875724595171328:0@lo:400:kworker.0 00000100:00100000:2.0:1788830608.094982:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25747c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1875724595171456:0@lo:400:kworker.0 00000100:00100000:2.0:1788830608.094995:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25747c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875724595171072:0@lo:400:kworker.0 00000100:00100000:1.0:1788830608.095073:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595171200 00000100:00100000:1.0:1788830608.095077:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595171200 00000100:00100000:1.0:1788830608.095106:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788830608.095114:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25658de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875724595171200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788830608.095161:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25658de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875724595171200:12345-0@lo:400:kworker.0 Request processed in 49us (936us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830608.095167:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788830608.095815:0:3309:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:0.0:1788830608.095823:0:3309:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967311 committed transno 4294967311 00000100:00100000:0.0:1788830608.095842:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25747c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875724595171200:0@lo:400:kworker.0 00010000:00010000:0.0:1788830608.412694:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788830608.605136:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788830608.609143:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257f730700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875724595171712:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788830608.609253:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830608.609704:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595171712 00000100:00100000:0.0:1788830608.609738:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595171712 00000100:00100000:0.0:1788830608.609814:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788830608.609826:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257e924000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875724595171712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788830608.609880:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788830608.609957:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257e924000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875724595171712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 132us (703us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830608.610093:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788830608.610265:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257f730700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875724595171712:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788830609.437409:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788830609.815893:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830609.818848:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578387072 00000100:00100000:2.0:1788830609.819702:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578387072 00000100:00080000:0.0:1788830609.819979:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788830609.820125:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 134 00000100:00100000:2.0:1788830609.820144:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25658ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+13:10223:x1875724578387072:12345-192.168.201.21@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1788830609.820338:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25658ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+13:10223:x1875724578387072:12345-192.168.201.21@tcp:60:lhsmtool_posix.0 Request processed in 200us (4472us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830609.820348:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 134 00000100:00100000:3.0:1788830609.826930:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830609.827223:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578387328 00000100:00100000:1.0:1788830609.827238:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578387328 00000100:00100000:1.0:1788830609.827322:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 34 00000100:00100000:1.0:1788830609.827337:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257e924700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+13:10223:x1875724578387328:12345-192.168.201.21@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788830609.829464:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257e924700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+14:10223:x1875724578387328:12345-192.168.201.21@tcp:35:lhsmtool_posix.0 Request processed in 2114us (2655us total) trans 4294967412 rc 0/0 00000100:00100000:1.0:1788830609.829481:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 34 00000100:00100000:3.0:1788830610.040920:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830610.041040:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578387456 00000100:00100000:0.0:1788830610.041053:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578387456 00000100:00100000:0.0:1788830610.041148:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 135 00000100:00100000:0.0:1788830610.041158:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257e925f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2154ea6-69cb-4a30-aac0-000fba13e98b+5:11031:x1875724578387456:12345-192.168.201.21@tcp:101:lsof.0 00010000:00010000:0.0:1788830610.041183:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788830610.041207:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f000/0x575506951eea142d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa578910534661e8e expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830610.041283:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea1434 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830610.041297:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea1434 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830610.041338:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea1434 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788830610.041384:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788830610.041388:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788830610.041441:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea1434 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830610.041471:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f000/0x575506951eea142d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661e8e expref: 7 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788830610.041580:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788830610.041624:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea1434 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661e8e expref: 6 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830610.041632:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e25530b0200) 00010000:00010000:0.0:1788830610.041634:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788830610.041638:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2445b7f800, rc 0) 00000100:00100000:0.0:1788830610.041792:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257e925f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2154ea6-69cb-4a30-aac0-000fba13e98b+6:11031:x1875724578387456:12345-192.168.201.21@tcp:101:lsof.0 Request processed in 634us (890us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830610.041799:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 135 00000040:00080000:3.0:1788830610.397207:0:11676:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788830610.397224:0:11676:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788830610.397617:0:11676:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:3.0:1788830610.397625:0:11676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1788830610.460742:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788830611.486051:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788830612.193199:0:6697:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 365540487397ns, next at 366540484567ns, rc = 0 00000100:00100000:1.0:1788830612.193293:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257f731880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875724595171840:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788830612.193372:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788830612.193437:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595171840 00000100:00100000:2.0:1788830612.193445:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595171840 00000100:00100000:2.0:1788830612.193515:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788830612.193526:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257f807800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875724595171840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788830612.193557:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788830612.193731:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257f807800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875724595171840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830612.193740:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:2.0:1788830612.193762:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788830612.193797:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257f731880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875724595171840:0@lo:13:osp-pre-0-0.0 00000001:00080000:3.0:1788830612.283127:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967412 is committed 00000020:00080000:3.0:1788830612.283147:0:5855:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000004:00080000:3.0:1788830612.283163:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000020:00080000:2.0:1788830612.284183:0:5866:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:2.0:1788830612.284199:0:5866:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000004:00080000:3.0:1788830612.284398:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000100:00100000:2.0:1788830612.288247:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257f731880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875724595171968:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788830612.288348:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788830612.288454:0:12010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595171968 00000100:00100000:2.0:1788830612.288463:0:12010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595171968 00000100:00100000:2.0:1788830612.288518:0:12010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788830612.288529:0:12010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257f731180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1875724595171968:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1788830612.290010:0:12010:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1788830612.290020:0:12010:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1788830600 -> 1788830600 00002000:00010000:2.0:1788830612.290023:0:12010:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 1788830600 -> 1788830600 00002000:00010000:2.0:1788830612.290026:0:12010:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1788830600 -> 1788830600 00002000:00010000:2.0:1788830612.290028:0:12010:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1788830612.290116:0:12010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257f731180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3307:x1875724595171968:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1586us (1765us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1788830612.290126:0:12010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000004:00080000:2.0:1788830612.290202:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e257f731880/2, rc 0, transno 4294967312 00000100:00100000:2.0:1788830612.290209:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257f731880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875724595171968:0@lo:2:osp-syn-0-0.0 00010000:00010000:1.0:1788830612.509292:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788830612.815447:0:6709:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00000001:02000400:0.0:1788830612.864322:0:12357:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 21:23:31 (1788830611) 00000100:00100000:2.0:1788830612.870933:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830612.871018:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830612.871057:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830612.871083:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830612.871110:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830612.871174:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578387968 00000100:00100000:3.0:1788830612.871188:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578387968 00000100:00100000:3.0:1788830612.871269:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578387840 00000100:00100000:3.0:1788830612.871272:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578387840 00000100:00100000:3.0:1788830612.871300:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 81 00000100:00100000:3.0:1788830612.871310:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257f730a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+5:2353:x1875724578387968:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:3.0:1788830612.871402:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257f730a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+5:2353:x1875724578387968:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 92us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830612.871411:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 81 00000100:00100000:3.0:1788830612.871428:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 82 00000100:00100000:3.0:1788830612.871434:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257f731f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+6:2352:x1875724578387840:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:3.0:1788830612.871462:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257f731f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+6:2352:x1875724578387840:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 28us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830612.871468:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 82 00000100:00080000:3.0:1788830612.872756:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788830612.872766:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788830612.872792:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578387584 00000100:00100000:3.0:1788830612.872803:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578387584 00000100:00100000:3.0:1788830612.872887:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 289 00000100:00100000:3.0:1788830612.872897:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2574710050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+13:2352:x1875724578387584:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:3.0:1788830612.872965:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2574710050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+13:2352:x1875724578387584:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 69us (1906us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830612.872973:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 289 00000100:00100000:1.0:1788830612.877430:0:8202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578387712 00000100:00100000:1.0:1788830612.877451:0:8202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578387712 00000100:00100000:1.0:1788830612.877541:0:8202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578388096 00000100:00100000:1.0:1788830612.877553:0:8202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578388096 00000100:00100000:1.0:1788830612.877590:0:8202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 132 00000100:00100000:1.0:1788830612.877600:0:8202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257f730700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+13:2353:x1875724578387712:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:1.0:1788830612.877743:0:8202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257f730700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+13:2353:x1875724578387712:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 145us (6826us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830612.877752:0:8202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 132 00000100:00100000:1.0:1788830612.877774:0:8202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 133 00000100:00100000:1.0:1788830612.877782:0:8202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257f730000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2154ea6-69cb-4a30-aac0-000fba13e98b+6:2352:x1875724578388096:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:1.0:1788830612.877807:0:8202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257f730000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2154ea6-69cb-4a30-aac0-000fba13e98b+6:2352:x1875724578388096:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 27us (6697us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830612.877825:0:8202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 133 00000100:00080000:0.0:1788830612.878551:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788830613.212213:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25658dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875724595172224:0@lo:400:kworker.0 00000100:00100000:3.0:1788830613.212312:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788830613.212453:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25658df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1745cc3d-3952-4cd4-9020-9b8acb483105:3308:1875724595172096:0@lo:400:kworker.0 00000100:00100000:1.0:1788830613.212502:0:8202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595172224 00000100:00100000:2.0:1788830613.212503:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830613.212513:0:8202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595172224 00000100:00100000:2.0:1788830613.212566:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595172096 00000100:00100000:2.0:1788830613.212571:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595172096 00000100:00100000:2.0:1788830613.212610:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:2.0:1788830613.212620:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255d949450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1745cc3d-3952-4cd4-9020-9b8acb483105+19:3308:x1875724595172096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788830613.213326:0:8202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788830613.213341:0:8202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257e924a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875724595172224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788830613.213486:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255d949450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1745cc3d-3952-4cd4-9020-9b8acb483105+19:3308:x1875724595172096:12345-0@lo:400:kworker.0 Request processed in 865us (981us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830613.213497:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:2.0:1788830613.213574:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25658df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1745cc3d-3952-4cd4-9020-9b8acb483105:3308:1875724595172096:0@lo:400:kworker.0 00000100:00100000:2.0:1788830613.213642:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25658dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875724595172352:0@lo:400:kworker.0 00000100:00100000:2.0:1788830613.213677:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788830613.213939:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595172352 00000100:00100000:2.0:1788830613.213945:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595172352 00000100:00100000:2.0:1788830613.213984:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788830613.213991:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257f731500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875724595172352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788830613.214033:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257f731500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875724595172352:12345-0@lo:400:kworker.0 Request processed in 43us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830613.214041:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788830613.214071:0:3310:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:2.0:1788830613.214078:0:3310:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e257f731880, transno 4294967312 00000100:00100000:2.0:1788830613.214094:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25658dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875724595172352:0@lo:400:kworker.0 00000100:00100000:0.0:1788830613.214150:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25658df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1875724595172608:0@lo:400:kworker.0 00000100:00100000:0.0:1788830613.214189:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830613.214215:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788830613.214222:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25658ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1875724595172480:0@lo:400:kworker.0 00000100:00100000:0.0:1788830613.214264:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830613.214303:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595172608 00000100:00100000:0.0:1788830613.214307:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595172608 00000100:00100000:0.0:1788830613.214341:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595172480 00000100:00100000:0.0:1788830613.214344:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595172480 00000100:00100000:0.0:1788830613.214362:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788830613.214369:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25658dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875724595172608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788830613.214406:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25658dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875724595172608:12345-0@lo:400:kworker.0 Request processed in 37us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830613.214412:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788830613.214426:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788830613.214432:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25658dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875724595172480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788830613.214456:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25658dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875724595172480:12345-0@lo:400:kworker.0 Request processed in 25us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830613.214462:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00080000:0.0:1788830613.214480:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788830613.214504:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25658ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1875724595172480:0@lo:400:kworker.0 00000100:00100000:0.0:1788830613.214515:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25658df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1875724595172608:0@lo:400:kworker.0 00000100:00100000:1.0:1788830613.214731:0:8202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257e924a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875724595172224:12345-0@lo:400:kworker.0 Request processed in 1394us (2416us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830613.214740:0:8202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788830613.214769:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788830613.214777:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25658dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875724595172736:0@lo:400:kworker.0 00000100:00100000:1.0:1788830613.214818:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830613.215021:0:12010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595172736 00000100:00100000:0.0:1788830613.215028:0:12010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595172736 00000100:00100000:0.0:1788830613.215074:0:12010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788830613.215079:0:12010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257f805f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1875724595172736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788830613.215110:0:12010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257f805f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1875724595172736:12345-0@lo:400:kworker.0 Request processed in 31us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830613.215114:0:12010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:1.0:1788830613.215196:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788830613.215214:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25658dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875724595172736:0@lo:400:kworker.0 00000100:00100000:3.0:1788830613.215286:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25658dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875724595172224:0@lo:400:kworker.0 00010000:00010000:1.0:1788830613.532090:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788830613.724310:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257f731880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875724595172864:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788830613.724439:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788830613.724496:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595172864 00000100:00100000:2.0:1788830613.724507:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595172864 00000100:00100000:2.0:1788830613.724584:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788830613.724595:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257f804380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875724595172864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788830613.724642:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788830613.726947:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257f804380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875724595172864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2339us (2495us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830613.726985:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788830613.736451:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257f731880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875724595172864:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788830614.017998:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830614.018186:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578388352 00000100:00100000:0.0:1788830614.018219:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578388352 00000100:00100000:0.0:1788830614.018363:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 136 00000100:00100000:0.0:1788830614.018377:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257ffddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+13:11297:x1875724578388352:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788830614.018410:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788830614.018437:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e400/0x575506951eea143b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa578910534661e95 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830614.018524:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e200/0x575506951eea1442 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830614.018540:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e200/0x575506951eea1442 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830614.018562:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e200/0x575506951eea1442 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830614.019172:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea1449 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830614.019181:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea1449 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830614.019187:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea1449 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830614.019530:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f000/0x575506951eea1450 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830614.019537:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f000/0x575506951eea1450 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830614.019542:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f000/0x575506951eea1450 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788830614.019557:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:0.0:1788830614.019848:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e200/0x575506951eea1442 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830614.019855:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e200/0x575506951eea1442 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830614.019860:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e200/0x575506951eea1442 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830614.019864:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2445b7e200 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:0.0:1788830614.019867:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e200/0x575506951eea1442 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830614.019873:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e200/0x575506951eea1442 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830614.019884:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9e25518dca00) 00010000:00010000:0.0:1788830614.019886:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788830614.019889:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e200/0x575506951eea1442 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830614.019893:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e200/0x575506951eea1442 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830614.019903:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea1449 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830614.019906:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea1449 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830614.019917:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea1449 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830614.019921:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2445b7ee00 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:0.0:1788830614.019922:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea1449 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830614.019926:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea1449 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830614.019930:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9e25518dcf00) 00010000:00010000:0.0:1788830614.019931:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788830614.019933:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea1449 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830614.019936:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea1449 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830614.022050:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e400/0x575506951eea143b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661e95 expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830614.022085:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f000/0x575506951eea1450 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661e95 expref: 15 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830614.022096:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e257480cd00) 00010000:00010000:0.0:1788830614.022100:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788830614.022104:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2445b7f000, rc 0) 00000100:00100000:0.0:1788830614.022213:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257ffddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+15:11297:x1875724578388352:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 Request processed in 3838us (4228us total) trans 4294967413 rc 0/0 00000100:00100000:0.0:1788830614.022243:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 136 00000100:00080000:1.0:1788830614.023942:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788830614.040544:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830614.040619:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830614.040659:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578388480 00000100:00100000:2.0:1788830614.040674:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578388480 00000100:00100000:2.0:1788830614.040789:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 10 00000100:00100000:2.0:1788830614.040811:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25658df800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+15:2355:x1875724578388480:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788830614.040831:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788830614.040867:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f000/0x575506951eea1450 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661e95 expref: 15 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830614.040890:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e257480cd00) 00010000:00010000:2.0:1788830614.040896:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788830614.040978:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25658df800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+14:2355:x1875724578388480:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 171us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830614.040987:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 10 00000100:00100000:3.0:1788830614.051056:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578388608 00000100:00100000:3.0:1788830614.051080:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578388608 00000100:00100000:3.0:1788830614.051323:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 137 00000100:00100000:3.0:1788830614.051337:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25658ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+14:11297:x1875724578388608:12345-192.168.201.21@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1788830614.051510:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25658ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+14:11297:x1875724578388608:12345-192.168.201.21@tcp:59:lhsmtool_posix.0 Request processed in 176us (10889us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830614.051520:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 137 00000040:00080000:3.0:1788830614.496367:0:11676:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788830614.496379:0:11676:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788830614.496421:0:11676:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:3.0:1788830614.496428:0:11676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1788830614.556063:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788830615.580080:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788830615.924345:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830615.924409:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578388736 00000100:00100000:2.0:1788830615.924423:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578388736 00000100:00100000:2.0:1788830615.924550:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 138 00000100:00100000:2.0:1788830615.924575:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257ffde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+14:11339:x1875724578388736:12345-192.168.201.21@tcp:101:lfs.0 00010000:00010000:2.0:1788830615.924604:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788830615.924631:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729800/0x575506951eea145e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa578910534661e9c expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830615.924740:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729400/0x575506951eea1465 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830615.924756:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729400/0x575506951eea1465 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830615.924799:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729400/0x575506951eea1465 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830615.924817:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728a00/0x575506951eea146c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830615.924824:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728a00/0x575506951eea146c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830615.924832:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728a00/0x575506951eea146c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830615.925091:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729400/0x575506951eea1465 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830615.925100:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729400/0x575506951eea1465 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830615.925108:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729400/0x575506951eea1465 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830615.925115:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2565729400 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:2.0:1788830615.925120:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729400/0x575506951eea1465 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830615.925129:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729400/0x575506951eea1465 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830615.925144:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e25530b0200) 00010000:00010000:2.0:1788830615.925148:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788830615.925153:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729400/0x575506951eea1465 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830615.925166:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729400/0x575506951eea1465 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830615.925179:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728a00/0x575506951eea146c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830615.925185:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728a00/0x575506951eea146c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830615.925190:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728a00/0x575506951eea146c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830615.925195:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2565728a00 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:2.0:1788830615.925198:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728a00/0x575506951eea146c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830615.925204:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728a00/0x575506951eea146c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830615.925212:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9e2551f3ea00) 00010000:00010000:2.0:1788830615.925215:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788830615.925218:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728a00/0x575506951eea146c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830615.925224:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728a00/0x575506951eea146c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830615.925262:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729800/0x575506951eea145e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661e9c expref: 15 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830615.925286:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e25530b0200) 00010000:00010000:2.0:1788830615.925288:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788830615.925304:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729800/0x575506951eea145e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661e9c expref: 15 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830615.925316:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2565729800, rc 0) 00000100:00100000:2.0:1788830615.925407:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257ffde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+14:11339:x1875724578388736:12345-192.168.201.21@tcp:101:lfs.0 Request processed in 835us (1076us total) trans 0 rc 301/301 00000100:00100000:2.0:1788830615.925416:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 138 00000100:00100000:2.0:1788830615.928916:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830615.929415:0:8202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578388992 00000100:00100000:1.0:1788830615.929429:0:8202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578388992 00000100:00100000:1.0:1788830615.929532:0:8202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 139 00000100:00100000:1.0:1788830615.929546:0:8202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257f733b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+14:11339:x1875724578388992:12345-192.168.201.21@tcp:36:lfs.0 00010000:00010000:1.0:1788830615.929616:0:8202:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788830615.929651:0:8202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d80e600/0x575506951eea0dea lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661cdc expref: 14 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830615.929673:0:8202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e25530b0200) 00010000:00010000:1.0:1788830615.929679:0:8202:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788830615.929964:0:8202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea1473 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830615.929979:0:8202:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea1434 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661e8e expref: 5 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830615.929985:0:8202:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea1473 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830615.930019:0:8202:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea1434 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.21@tcp remote: 0xa578910534661e8e expref: 5 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830615.930032:0:8202:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea1434 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661e8e expref: 5 pid: 5833 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788830615.930052:0:8202:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257f804e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8202:1875724595172992:192.168.201.21@tcp:104: 00000100:00100000:1.0:1788830615.930170:0:8202:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2553723c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788830615.936479:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830615.936626:0:8202:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257f804e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8202:1875724595172992:192.168.201.21@tcp:104: 00010000:00010000:1.0:1788830615.936665:0:8202:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea1473 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788830615.936808:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578389120 00000100:00100000:2.0:1788830615.936818:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578389120 00010000:00010000:2.0:1788830615.936876:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea1434 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661e8e expref: 6 pid: 5833 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788830615.936921:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 61 00000100:00100000:2.0:1788830615.936933:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25658dca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c2154ea6-69cb-4a30-aac0-000fba13e98b+6:2354:x1875724578389120:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788830615.936951:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788830615.936959:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea1434 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661e8e expref: 6 pid: 5833 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830615.936974:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea1434 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661e8e expref: 6 pid: 5833 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830615.937001:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea1434 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661e8e expref: 6 pid: 5833 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830615.937028:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e25530b0200) 00010000:00010000:2.0:1788830615.937034:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea1473 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830615.937043:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea1473 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830615.937051:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea1473 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830615.937078:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788830615.937147:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25658dca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c2154ea6-69cb-4a30-aac0-000fba13e98b+5:2354:x1875724578389120:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 216us (683us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830615.937154:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 61 00010000:00010000:2.0:1788830615.937274:0:8202:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea1473 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830615.937282:0:8202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea1473 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830615.937319:0:8202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728a00/0x575506951eea147a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830615.937330:0:8202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728a00/0x575506951eea147a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830615.937339:0:8202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728a00/0x575506951eea147a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788830615.938552:0:8202:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1788830615.938576:0:8202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea1473 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830615.938586:0:8202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea1473 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830615.938594:0:8202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea1473 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830615.938601:0:8202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e25820fe400 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:2.0:1788830615.938607:0:8202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea1473 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830615.938616:0:8202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea1473 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830615.938632:0:8202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e25530b0200) 00010000:00010000:2.0:1788830615.938636:0:8202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788830615.938641:0:8202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea1473 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830615.938648:0:8202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea1473 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788830615.938669:0:8202:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dfc1f1be reply state 000000004bab0fb4 transno 4294967414 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728a00/0x575506951eea147a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788830615.938679:0:8202:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788830615.938838:0:8202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257f733b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+15:11339:x1875724578388992:12345-192.168.201.21@tcp:36:lfs.0 Request processed in 9289us (9933us total) trans 4294967414 rc 0/0 00000100:00100000:2.0:1788830615.938847:0:8202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 139 00000100:00080000:1.0:1788830615.939437:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788830615.946056:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728a00/0x575506951eea147a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830615.946074:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728a00/0x575506951eea147a lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830615.946080:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728a00/0x575506951eea147a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830615.946085:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2565728a00 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:1.0:1788830615.946089:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728a00/0x575506951eea147a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830615.946095:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728a00/0x575506951eea147a lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830615.946112:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9e2551f3ea00) 00010000:00010000:1.0:1788830615.946114:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788830615.946118:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728a00/0x575506951eea147a lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830615.946122:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728a00/0x575506951eea147a lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788830616.005474:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830616.005912:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578389248 00000100:00100000:1.0:1788830616.005926:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578389248 00000100:00100000:1.0:1788830616.006016:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 140 00000100:00100000:1.0:1788830616.006028:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25658dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+14:11347:x1875724578389248:12345-192.168.201.21@tcp:101:lctl.0 00010000:00010000:1.0:1788830616.006058:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788830616.006100:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff400/0x575506951eea1481 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa578910534661ea3 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830616.006196:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea1488 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830616.006213:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea1488 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830616.006227:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea1488 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788830616.006282:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788830616.006288:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788830616.006326:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea1488 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830616.006360:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff400/0x575506951eea1481 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661ea3 expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830616.006382:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea1488 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661ea3 expref: 15 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830616.006395:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e257480c400) 00010000:00010000:1.0:1788830616.006404:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788830616.006409:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e25820fe400, rc 0) 00000100:00080000:3.0:1788830616.006412:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788830616.007100:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25658dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+15:11347:x1875724578389248:12345-192.168.201.21@tcp:101:lctl.0 Request processed in 1067us (1631us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830616.007110:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 140 00000100:00100000:0.0:1788830616.053007:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830616.053123:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578389376 00000100:00100000:3.0:1788830616.053199:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578389376 00000100:00100000:3.0:1788830616.053325:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 141 00000100:00100000:3.0:1788830616.053338:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25658dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+15:11353:x1875724578389376:12345-192.168.201.21@tcp:101:bash.0 00010000:00010000:3.0:1788830616.053366:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788830616.053395:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944800/0x575506951eea148f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa578910534661eaa expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830616.053493:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945400/0x575506951eea1496 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830616.053511:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945400/0x575506951eea1496 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830616.053534:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945400/0x575506951eea1496 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830616.053550:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944200/0x575506951eea149d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830616.053557:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944200/0x575506951eea149d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830616.053563:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944200/0x575506951eea149d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830616.053840:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944a00/0x575506951eea14a4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830616.053850:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944a00/0x575506951eea14a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830616.053858:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944a00/0x575506951eea14a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788830616.053892:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:3.0:1788830616.053896:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788830616.053919:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944a00/0x575506951eea14a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830616.053934:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945400/0x575506951eea1496 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830616.053941:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945400/0x575506951eea1496 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830616.053956:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945400/0x575506951eea1496 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830616.053963:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e257d945400 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:3.0:1788830616.053968:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945400/0x575506951eea1496 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830616.053976:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945400/0x575506951eea1496 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830616.053991:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e257480c400) 00010000:00010000:3.0:1788830616.053995:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788830616.054000:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945400/0x575506951eea1496 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830616.054006:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945400/0x575506951eea1496 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830616.054022:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944200/0x575506951eea149d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830616.054028:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944200/0x575506951eea149d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830616.054033:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944200/0x575506951eea149d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830616.054037:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e257d944200 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:3.0:1788830616.054040:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944200/0x575506951eea149d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830616.054053:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944200/0x575506951eea149d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830616.054061:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9e25530b0f00) 00010000:00010000:3.0:1788830616.054064:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788830616.054066:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944200/0x575506951eea149d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830616.054072:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944200/0x575506951eea149d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830616.054109:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944800/0x575506951eea148f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661eaa expref: 17 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830616.054125:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944a00/0x575506951eea14a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661eaa expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830616.054134:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e25530b0b00) 00010000:00010000:3.0:1788830616.054136:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788830616.054138:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e257d944a00, rc 0) 00000100:00100000:3.0:1788830616.054225:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25658dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+16:11353:x1875724578389376:12345-192.168.201.21@tcp:101:bash.0 Request processed in 889us (1232us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830616.054234:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 141 00000100:00100000:3.0:1788830616.059825:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830616.061218:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578389632 00000100:00100000:1.0:1788830616.061233:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578389632 00000100:00100000:1.0:1788830616.061307:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 142 00000100:00100000:1.0:1788830616.061319:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257ffddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+16:11353:x1875724578389632:12345-192.168.201.21@tcp:101:bash.0 00010000:00010000:1.0:1788830616.061358:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788830616.061388:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff400/0x575506951eea14ab lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa578910534661eb1 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830616.061562:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffa00/0x575506951eea14b2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830616.061581:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffa00/0x575506951eea14b2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830616.061596:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffa00/0x575506951eea14b2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830616.061915:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea14b9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830616.061939:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea14b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830616.061951:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea14b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788830616.063015:0:5833:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:1.0:1788830616.063375:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2540030a00/0x575506951eea14c0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830616.063388:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2540030a00/0x575506951eea14c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830616.063399:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2540030a00/0x575506951eea14c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830616.063437:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffa00/0x575506951eea14b2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830616.063445:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffa00/0x575506951eea14b2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830616.063452:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffa00/0x575506951eea14b2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830616.063458:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e25820ffa00 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:1.0:1788830616.063463:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffa00/0x575506951eea14b2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830616.063471:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffa00/0x575506951eea14b2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830616.063484:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e25530b0b00) 00010000:00010000:1.0:1788830616.063488:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788830616.063492:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffa00/0x575506951eea14b2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830616.063511:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffa00/0x575506951eea14b2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788830616.063526:0:5833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006bc67fbd reply state 0000000044064a14 transno 4294967415 ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea14b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788830616.063603:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788830616.063645:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff400/0x575506951eea14ab lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661eb1 expref: 19 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830616.063660:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2540030a00/0x575506951eea14c0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661eb1 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830616.063829:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e257480c700) 00010000:00010000:1.0:1788830616.063832:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788830616.063835:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2540030a00, rc 0) 00000100:00100000:1.0:1788830616.064466:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257ffddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+19:11353:x1875724578389632:12345-192.168.201.21@tcp:101:bash.0 Request processed in 3146us (4790us total) trans 4294967415 rc 0/0 00000100:00100000:1.0:1788830616.064475:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 142 00010000:00010000:0.0:1788830616.066403:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea14b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830616.066428:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea14b9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830616.066437:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea14b9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830616.066445:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e25820ff800 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:0.0:1788830616.066462:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea14b9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830616.066472:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea14b9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830616.066494:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9e257480c800) 00010000:00010000:0.0:1788830616.066498:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788830616.066504:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea14b9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830616.066511:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea14b9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788830616.069350:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830616.069571:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578389760 00000100:00100000:2.0:1788830616.069600:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578389760 00000100:00100000:2.0:1788830616.069700:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 49 00000100:00100000:2.0:1788830616.069738:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257ffdc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+5:2355:x1875724578389760:12345-192.168.201.21@tcp:101:bash.0 00010000:00010000:2.0:1788830616.069775:0:6679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788830616.069808:0:6679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c8eb72d0/0x575506951eea14ce lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa578910534661eb8 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788830616.069845:0:6679:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788830616.069870:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=369s v=(0 0) 00010000:00010000:2.0:1788830616.069876:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788830616.069888:0:6679:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c8eb72d0/0x575506951eea14ce lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661eb8 expref: 6 pid: 6679 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830616.069912:0:6679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c8eb72d0/0x575506951eea14ce lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661eb8 expref: 6 pid: 6679 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830616.069927:0:6679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2565729a00, rc 0) 00000100:00100000:2.0:1788830616.070000:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257ffdc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+6:2355:x1875724578389760:12345-192.168.201.21@tcp:101:bash.0 Request processed in 290us (666us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830616.070007:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 49 00000100:00080000:3.0:1788830616.070089:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788830616.073936:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830616.073982:0:12010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578389888 00000100:00100000:0.0:1788830616.073995:0:12010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578389888 00000100:00100000:0.0:1788830616.074056:0:12010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 50 00000100:00100000:0.0:1788830616.074067:0:12010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25658df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+6:11353:x1875724578389888:12345-192.168.201.21@tcp:101:bash.0 00010000:00010000:0.0:1788830616.074094:0:12010:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788830616.074122:0:12010:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000088c3f4c6/0x575506951eea14d5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa578910534661ebf expref: -99 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830616.074163:0:12010:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c8eb72d0/0x575506951eea14ce lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661eb8 expref: 7 pid: 6679 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830616.074174:0:12010:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788830616.074179:0:12010:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788830616.074185:0:12010:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000088c3f4c6/0x575506951eea14d5 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661ebf expref: 7 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830616.074230:0:12010:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c8eb72d0/0x575506951eea14ce lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.21@tcp remote: 0xa578910534661eb8 expref: 7 pid: 6679 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830616.074246:0:12010:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c8eb72d0/0x575506951eea14ce lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661eb8 expref: 7 pid: 6679 timeout: 469 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788830616.074262:0:12010:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25658e2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:12010:1875724595173120:192.168.201.21@tcp:104: 00000100:00100000:0.0:1788830616.074381:0:12010:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2545cc9e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788830616.077041:0:12010:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25658e2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:12010:1875724595173120:192.168.201.21@tcp:104: 00010000:00010000:1.0:1788830616.077093:0:12010:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000088c3f4c6/0x575506951eea14d5 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.21@tcp remote: 0xa578910534661ebf expref: 7 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830616.077122:0:12010:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2445b7f800, rc 0) 00000100:00100000:1.0:1788830616.077197:0:12010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25658df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+7:11353:x1875724578389888:12345-192.168.201.21@tcp:101:bash.0 Request processed in 3131us (3275us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830616.077215:0:12010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 50 00000100:00100000:3.0:1788830616.078545:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830616.078682:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578390016 00000100:00100000:2.0:1788830616.078694:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578390016 00010000:00010000:2.0:1788830616.078867:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c8eb72d0/0x575506951eea14ce lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661eb8 expref: 7 pid: 6679 timeout: 469 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788830616.078994:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 62 00000100:00100000:1.0:1788830616.079009:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2565498e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+7:2354:x1875724578390016:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788830616.079030:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788830616.079059:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c8eb72d0/0x575506951eea14ce lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661eb8 expref: 7 pid: 6679 timeout: 469 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830616.079075:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c8eb72d0/0x575506951eea14ce lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661eb8 expref: 7 pid: 6679 timeout: 469 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830616.079104:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c8eb72d0/0x575506951eea14ce lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661eb8 expref: 7 pid: 6679 timeout: 469 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830616.079123:0:5817:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788830616.079129:0:5817:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788830616.079139:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000088c3f4c6/0x575506951eea14d5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.21@tcp remote: 0xa578910534661ebf expref: 6 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830616.079152:0:5817:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000088c3f4c6/0x575506951eea14d5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.21@tcp remote: 0xa578910534661ebf expref: 6 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830616.079202:0:5817:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000088c3f4c6/0x575506951eea14d5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.21@tcp remote: 0xa578910534661ebf expref: 6 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788830616.079218:0:5817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257f804e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5817:1875724595173248:192.168.201.21@tcp:105: 00000100:00100000:1.0:1788830616.079398:0:5817:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2553723c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788830616.081618:0:5817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257f804e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5817:1875724595173248:192.168.201.21@tcp:105: 00010000:00010000:1.0:1788830616.081657:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788830616.081981:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2565498e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+6:2354:x1875724578390016:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 2973us (3443us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830616.081983:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830616.081994:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 62 00000100:00100000:2.0:1788830616.082227:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578390272 00000100:00100000:2.0:1788830616.082236:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578390272 00000100:00100000:2.0:1788830616.082291:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 35 00000100:00100000:2.0:1788830616.082302:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e256549aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+18:11353:x1875724578390272:12345-192.168.201.21@tcp:35:bash.0 00000100:00100000:2.0:1788830616.082782:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e256549aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+19:11353:x1875724578390272:12345-192.168.201.21@tcp:35:bash.0 Request processed in 481us (797us total) trans 4294967416 rc 0/0 00000100:00100000:2.0:1788830616.082790:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 35 00000100:00100000:0.0:1788830616.130520:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830616.130675:0:8202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578390528 00000100:00100000:2.0:1788830616.130842:0:8202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578390528 00000100:00100000:2.0:1788830616.130923:0:8202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 143 00000100:00100000:2.0:1788830616.130934:0:8202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25658e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+19:11363:x1875724578390528:12345-192.168.201.21@tcp:101:lfs.0 00010000:00010000:2.0:1788830616.130966:0:8202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788830616.130993:0:8202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728e00/0x575506951eea14dc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa578910534661ec6 expref: -99 pid: 8202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788830616.131121:0:8202:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1788830616.131286:0:8202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728e00/0x575506951eea14dc lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661ec6 expref: 21 pid: 8202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830616.131895:0:8202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e257480c400) 00010000:00010000:2.0:1788830616.131899:0:8202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788830616.131907:0:8202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728e00/0x575506951eea14dc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661ec6 expref: 21 pid: 8202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830616.131927:0:8202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2565728e00, rc 0) 00000100:00100000:2.0:1788830616.132022:0:8202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25658e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+20:11363:x1875724578390528:12345-192.168.201.21@tcp:101:lfs.0 Request processed in 1088us (1518us total) trans 4294967417 rc 301/301 00000100:00100000:2.0:1788830616.132031:0:8202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 143 00000100:00100000:0.0:1788830616.134942:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830616.135014:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578390784 00000100:00100000:1.0:1788830616.135028:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578390784 00000100:00100000:1.0:1788830616.135132:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 36 00000100:00100000:1.0:1788830616.135147:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25747c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+20:11363:x1875724578390784:12345-192.168.201.21@tcp:35:lfs.0 00000100:00100000:1.0:1788830616.135527:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25747c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+21:11363:x1875724578390784:12345-192.168.201.21@tcp:35:lfs.0 Request processed in 383us (599us total) trans 4294967418 rc 0/0 00000100:00100000:1.0:1788830616.135537:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 36 00000100:00100000:3.0:1788830616.206436:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830616.207097:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578390912 00000100:00100000:1.0:1788830616.207112:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578390912 00000100:00100000:1.0:1788830616.207191:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 144 00000100:00100000:1.0:1788830616.207204:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2565498380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+21:11369:x1875724578390912:12345-192.168.201.21@tcp:101:lfs.0 00010000:00010000:1.0:1788830616.207239:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788830616.207269:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea14ea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa578910534661ecd expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830616.207353:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff400/0x575506951eea14f1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830616.207367:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff400/0x575506951eea14f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830616.207397:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff400/0x575506951eea14f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788830616.207439:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:1.0:1788830616.207442:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788830616.207463:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff400/0x575506951eea14f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830616.207496:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea14ea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661ecd expref: 23 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830616.207515:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff400/0x575506951eea14f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661ecd expref: 22 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830616.207523:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e25530b0b00) 00010000:00010000:1.0:1788830616.207525:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788830616.207527:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e25820ff400, rc 0) 00000100:00100000:1.0:1788830616.207600:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2565498380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+22:11369:x1875724578390912:12345-192.168.201.21@tcp:101:lfs.0 Request processed in 400us (1181us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830616.207604:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 144 00000100:00100000:0.0:1788830616.216003:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830616.216287:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578391168 00000100:00100000:3.0:1788830616.216310:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578391168 00000100:00100000:3.0:1788830616.216394:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 145 00000100:00100000:3.0:1788830616.216407:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25747c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+22:11369:x1875724578391168:12345-192.168.201.21@tcp:101:lfs.0 00010000:00010000:3.0:1788830616.216434:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788830616.216462:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944800/0x575506951eea14f8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa578910534661ed4 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830616.217392:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944200/0x575506951eea14ff lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830616.217418:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944200/0x575506951eea14ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830616.217433:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944200/0x575506951eea14ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788830616.217447:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1788830616.217620:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944800/0x575506951eea14f8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661ed4 expref: 25 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830616.217643:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944200/0x575506951eea14ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661ed4 expref: 24 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830616.217654:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e257480c700) 00010000:00010000:3.0:1788830616.217657:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788830616.217660:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e257d944200, rc 0) 00000100:00100000:3.0:1788830616.217882:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25747c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+24:11369:x1875724578391168:12345-192.168.201.21@tcp:101:lfs.0 Request processed in 1475us (1890us total) trans 4294967419 rc 0/0 00000100:00100000:3.0:1788830616.217920:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 145 00000100:00100000:0.0:1788830616.221340:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830616.221558:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578391296 00000100:00100000:2.0:1788830616.221587:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578391296 00000100:00100000:2.0:1788830616.221675:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 11 00000100:00100000:2.0:1788830616.221689:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25747c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+24:2352:x1875724578391296:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788830616.221873:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788830616.221906:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944200/0x575506951eea14ff lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661ed4 expref: 24 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830616.221930:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e257480c700) 00010000:00010000:2.0:1788830616.221936:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788830616.222229:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25747c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+23:2352:x1875724578391296:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 541us (900us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830616.222237:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 11 00000100:00100000:0.0:1788830616.224452:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830616.225871:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578391552 00000100:00100000:2.0:1788830616.225892:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578391552 00000100:00100000:2.0:1788830616.226196:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 146 00000100:00100000:2.0:1788830616.226212:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25747c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+23:11369:x1875724578391552:12345-192.168.201.21@tcp:101:lfs.0 00010000:00010000:2.0:1788830616.226248:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788830616.226278:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728e00/0x575506951eea150d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa578910534661edb expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830616.226896:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729a00/0x575506951eea1514 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830616.226918:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729a00/0x575506951eea1514 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830616.226934:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729a00/0x575506951eea1514 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788830616.226973:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788830616.227578:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728e00/0x575506951eea150d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661edb expref: 26 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830616.227605:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729a00/0x575506951eea1514 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661edb expref: 25 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830616.227617:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e257480c700) 00010000:00010000:2.0:1788830616.227621:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788830616.227625:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2565729a00, rc 0) 00000100:00100000:2.0:1788830616.228051:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25747c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+25:11369:x1875724578391552:12345-192.168.201.21@tcp:101:lfs.0 Request processed in 1840us (3611us total) trans 4294967420 rc 0/0 00000100:00100000:2.0:1788830616.228181:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 146 00000100:00100000:3.0:1788830616.233110:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830616.233404:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578391680 00000100:00100000:2.0:1788830616.233417:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578391680 00000100:00100000:2.0:1788830616.233565:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 51 00000100:00100000:2.0:1788830616.233579:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e256549bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+6:2355:x1875724578391680:12345-192.168.201.21@tcp:1:lfs.0 00010000:00010000:2.0:1788830616.233906:0:6679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009f4303fc/0x575506951eea1522 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830616.233935:0:6679:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000088c3f4c6/0x575506951eea14d5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.21@tcp remote: 0xa578910534661ebf expref: 6 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830616.233944:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788830616.233950:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788830616.233956:0:6679:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009f4303fc/0x575506951eea1522 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830616.234216:0:6679:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000088c3f4c6/0x575506951eea14d5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.21@tcp remote: 0xa578910534661ebf expref: 6 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830616.234235:0:6679:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000088c3f4c6/0x575506951eea14d5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.21@tcp remote: 0xa578910534661ebf expref: 6 pid: 12010 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788830616.234255:0:6679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257f731880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6679:1875724595173376:192.168.201.21@tcp:104: 00000100:00100000:2.0:1788830616.234384:0:6679:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2565619780 going to sleep for 11 seconds 00000100:00100000:0.0:1788830616.237413:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830616.237995:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578391808 00000100:00100000:1.0:1788830616.238008:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578391808 00002000:00100000:1.0:1788830616.238088:0:6683:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9e257fac8000 x1875724578391808/t0(0) o4->1ef2fe7a-e5ec-4085-8326-b72aa00876cd@192.168.201.21@tcp:67/0 lens 504/0 e 0 to 0 dl 1788830627 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788830616.238102:0:6683:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e257fac8000 with x1875724578391808 ext(0->12) 00010000:00010000:1.0:1788830616.238113:0:6683:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000088c3f4c6/0x575506951eea14d5 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.21@tcp remote: 0xa578910534661ebf expref: 7 pid: 12010 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830616.238147:0:6683:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000088c3f4c6/0x575506951eea14d5 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.21@tcp remote: 0xa578910534661ebf expref: 7 pid: 12010 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788830616.238156:0:6683:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9e257fac8000 00000100:00100000:1.0:1788830616.238191:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 2 00000100:00100000:1.0:1788830616.238203:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257fac8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+7:2354:x1875724578391808:12345-192.168.201.21@tcp:4:lfs.0 00000100:00100000:1.0:1788830616.238958:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257fac8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+9:2354:x1875724578391808:12345-192.168.201.21@tcp:4:lfs.0 Request processed in 753us (1556us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1788830616.238968:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 2 00002000:00100000:1.0:1788830616.238978:0:6683:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9e257fac8000 x1875724578391808/t4294967305(0) o4->1ef2fe7a-e5ec-4085-8326-b72aa00876cd@192.168.201.21@tcp:67/0 lens 504/448 e 0 to 0 dl 1788830627 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788830616.238986:0:6683:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e257fac8000 with x1875724578391808 ext(0->12) 00010000:00010000:1.0:1788830616.238993:0:6683:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000088c3f4c6/0x575506951eea14d5 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.21@tcp remote: 0xa578910534661ebf expref: 9 pid: 12010 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830616.239008:0:6683:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000088c3f4c6/0x575506951eea14d5 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.21@tcp remote: 0xa578910534661ebf expref: 9 pid: 12010 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788830616.239016:0:6683:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9e257fac8000 00000100:00100000:2.0:1788830616.242105:0:6679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257f731880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6679:1875724595173376:192.168.201.21@tcp:104: 00010000:00010000:2.0:1788830616.242152:0:6679:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009f4303fc/0x575506951eea1522 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788830616.242703:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830616.242877:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578391936 00000100:00100000:2.0:1788830616.242887:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578391936 00010000:00010000:2.0:1788830616.242937:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000088c3f4c6/0x575506951eea14d5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.21@tcp remote: 0xa578910534661ebf expref: 9 pid: 12010 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788830616.242976:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 63 00000100:00100000:2.0:1788830616.242988:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257facbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+9:2355:x1875724578391936:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788830616.243009:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1788830616.243034:0:5819:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1788830616.243038:0:5819:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788830615 00002000:00010000:2.0:1788830616.243041:0:5819:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788830615 00002000:00010000:2.0:1788830616.243043:0:5819:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1788830615 00010000:00010000:2.0:1788830616.243079:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000088c3f4c6/0x575506951eea14d5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.21@tcp remote: 0xa578910534661ebf expref: 9 pid: 12010 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830616.243094:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000088c3f4c6/0x575506951eea14d5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.21@tcp remote: 0xa578910534661ebf expref: 9 pid: 12010 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830616.243124:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000088c3f4c6/0x575506951eea14d5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.21@tcp remote: 0xa578910534661ebf expref: 9 pid: 12010 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830616.243146:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788830616.243152:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788830616.243159:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009f4303fc/0x575506951eea1522 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830616.243171:0:5819:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009f4303fc/0x575506951eea1522 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830616.243209:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788830616.243275:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257facbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+8:2355:x1875724578391936:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 289us (574us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830616.243283:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 63 00010000:00010000:3.0:1788830616.243626:0:6679:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009f4303fc/0x575506951eea1522 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830616.243637:0:6679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009f4303fc/0x575506951eea1522 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830616.243668:0:6679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009f4303fc/0x575506951eea1522 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830616.243685:0:6679:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009f4303fc/0x575506951eea1522 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830616.243694:0:6679:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009f4303fc/0x575506951eea1522 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830616.243702:0:6679:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2565729000 already unused, calling callback (ffffffffc14cb350) 00010000:00010000:3.0:1788830616.243740:0:6679:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009f4303fc/0x575506951eea1522 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830616.243752:0:6679:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009f4303fc/0x575506951eea1522 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830616.243774:0:6679:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009f4303fc/0x575506951eea1522 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830616.243801:0:6679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009f4303fc/0x575506951eea1522 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788830616.243862:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e256549bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+7:2355:x1875724578391680:12345-192.168.201.21@tcp:1:lfs.0 Request processed in 10287us (10769us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830616.243871:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 51 00000100:00100000:0.0:1788830616.247391:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830616.247867:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578392192 00000100:00100000:2.0:1788830616.247882:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578392192 00000100:00100000:2.0:1788830616.247962:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 37 00000100:00100000:2.0:1788830616.247974:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25629b1450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+25:11369:x1875724578392192:12345-192.168.201.21@tcp:35:lfs.0 00000004:00010000:2.0:1788830616.248073:0:5836:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729a00/0x575506951eea1514 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661edb expref: 25 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788830616.248482:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967421 00000001:00080000:2.0:1788830616.248530:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967422 00000001:00080000:2.0:1788830616.249192:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00010000:00010000:2.0:1788830616.249264:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728e00/0x575506951eea1529 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830616.249285:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2540030a00/0x575506951eea14c0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661eb1 expref: 29 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830616.249296:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728e00/0x575506951eea1529 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830616.249342:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e2540030a00/0x575506951eea14c0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.21@tcp remote: 0xa578910534661eb1 expref: 29 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830616.249363:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2540030a00/0x575506951eea14c0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661eb1 expref: 29 pid: 5833 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788830616.249380:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257f731880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5836:1875724595173504:192.168.201.21@tcp:104: 00000100:00100000:2.0:1788830616.249504:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2565619780 going to sleep for 11 seconds 00000100:00100000:0.0:1788830616.252793:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830616.252886:0:11161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578392320 00000100:00100000:1.0:1788830616.252899:0:11161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578392320 00010000:00010000:1.0:1788830616.252951:0:11161:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2540030a00/0x575506951eea14c0 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661eb1 expref: 30 pid: 5833 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788830616.253030:0:11161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 64 00000100:00100000:1.0:1788830616.253042:0:11161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255da6b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+30:2355:x1875724578392320:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788830616.253071:0:11161:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788830616.253080:0:11161:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e2540030a00/0x575506951eea14c0 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661eb1 expref: 30 pid: 5833 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830616.253094:0:11161:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e2540030a00/0x575506951eea14c0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661eb1 expref: 30 pid: 5833 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830616.253122:0:11161:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e257480c700) 00010000:00010000:1.0:1788830616.253130:0:11161:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728e00/0x575506951eea1529 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830616.253142:0:11161:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728e00/0x575506951eea1529 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830616.253151:0:11161:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728e00/0x575506951eea1529 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830616.253177:0:11161:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788830616.253243:0:11161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255da6b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+30:2355:x1875724578392320:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 203us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830616.253251:0:11161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 64 00010000:00010000:2.0:1788830616.253576:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2540030a00/0x575506951eea14c0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661eb1 expref: 29 pid: 5833 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788830616.253599:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257f731880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5836:1875724595173504:192.168.201.21@tcp:104: 00010000:00010000:2.0:1788830616.253628:0:5836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728e00/0x575506951eea1529 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830616.253653:0:5836:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728e00/0x575506951eea1529 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830616.253660:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728e00/0x575506951eea1529 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788830616.253873:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:2.0:1788830616.254141:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00000100:00100000:2.0:1788830616.254279:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257f731880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5836:1875724595173632:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788830616.255785:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788830616.255871:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2565619300 going to sleep for 11 seconds 00000100:00100000:1.0:1788830616.259247:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595173632 00000100:00100000:1.0:1788830616.259269:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595173632 00000100:00100000:1.0:1788830616.259674:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788830616.259688:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2566011500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5836:x1875724595173632:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788830616.259926:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2566011500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5836:x1875724595173632:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 241us (4150us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830616.259933:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788830616.261136:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257f731880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5836:1875724595173632:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1788830616.262065:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000100:00100000:0.0:1788830616.262197:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257fac9c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5836:1875724595173760:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788830616.262280:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830616.262324:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2444a6c600 going to sleep for 11 seconds 00000100:00100000:1.0:1788830616.262547:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595173760 00000100:00100000:1.0:1788830616.262558:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595173760 00000100:00100000:1.0:1788830616.262626:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788830616.262638:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257fac9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5836:x1875724595173760:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788830616.262909:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257fac9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5836:x1875724595173760:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 273us (628us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1788830616.262917:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788830616.262942:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257fac9c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5836:1875724595173760:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1788830616.263020:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00010000:00010000:2.0:1788830616.263075:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728e00/0x575506951eea1529 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830616.263087:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728e00/0x575506951eea1529 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830616.263096:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728e00/0x575506951eea1529 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830616.263103:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2565728e00 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:2.0:1788830616.263109:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728e00/0x575506951eea1529 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830616.263118:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728e00/0x575506951eea1529 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830616.263138:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e257480c700) 00010000:00010000:2.0:1788830616.263152:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1788830616.263158:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728e00/0x575506951eea1529 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830616.263165:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728e00/0x575506951eea1529 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788830616.263393:0:5836:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788830616.263529:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:2.0:1788830616.263543:0:5836:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 369610833417ns, next at 370610830940ns, rc = 0 00000001:00080000:2.0:1788830616.263551:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00010000:00010000:2.0:1788830616.263590:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e257480c700) 00010000:00010000:2.0:1788830616.263593:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788830616.263601:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729a00/0x575506951eea1514 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661edb expref: 33 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788830616.264201:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25629b1450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+32:11369:x1875724578392192:12345-192.168.201.21@tcp:35:lfs.0 Request processed in 16094us (16691us total) trans 4294967429 rc 0/0 00000100:00100000:2.0:1788830616.264213:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 37 00000020:00080000:2.0:1788830616.264220:0:5836:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00080000:3.0:1788830616.264542:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788830616.266206:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830616.266276:0:8202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578392448 00000100:00100000:2.0:1788830616.266288:0:8202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578392448 00000100:00100000:2.0:1788830616.266356:0:8202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 147 00000100:00100000:2.0:1788830616.266368:0:8202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257faca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+32:11369:x1875724578392448:12345-192.168.201.21@tcp:101:lfs.0 00010000:00010000:2.0:1788830616.266401:0:8202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788830616.266428:0:8202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728a00/0x575506951eea1530 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa578910534661ee2 expref: -99 pid: 8202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830616.266506:0:8202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728a00/0x575506951eea1530 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661ee2 expref: 33 pid: 8202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830616.266540:0:8202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728a00/0x575506951eea1530 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661ee2 expref: 33 pid: 8202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830616.266563:0:8202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e2551f3e400) 00010000:00010000:2.0:1788830616.266566:0:8202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788830616.266570:0:8202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2565728a00, rc 0) 00000100:00100000:2.0:1788830616.266636:0:8202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257faca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+33:11369:x1875724578392448:12345-192.168.201.21@tcp:101:lfs.0 Request processed in 271us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830616.266643:0:8202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 147 00000100:00100000:1.0:1788830616.279219:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830616.287121:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578392704 00000100:00100000:3.0:1788830616.287144:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578392704 00000100:00100000:3.0:1788830616.287284:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 38 00000100:00100000:3.0:1788830616.287298:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257f804e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+33:11369:x1875724578392704:12345-192.168.201.21@tcp:35:lfs.0 00000100:00100000:3.0:1788830616.287668:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257f804e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+34:11369:x1875724578392704:12345-192.168.201.21@tcp:35:lfs.0 Request processed in 373us (8596us total) trans 4294967430 rc 0/0 00000100:00100000:3.0:1788830616.287678:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 38 00000100:00100000:0.0:1788830616.371383:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830616.371533:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578392960 00000100:00100000:1.0:1788830616.371548:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578392960 00000100:00100000:1.0:1788830616.371633:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 148 00000100:00100000:1.0:1788830616.371646:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257fac8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+34:11379:x1875724578392960:12345-192.168.201.21@tcp:101:lfs.0 00010000:00010000:1.0:1788830616.371679:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788830616.371764:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffa00/0x575506951eea1537 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa578910534661ee9 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788830616.371902:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1788830616.372086:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffa00/0x575506951eea1537 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661ee9 expref: 36 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830616.372104:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e257480c400) 00010000:00010000:1.0:1788830616.372108:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788830616.372114:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffa00/0x575506951eea1537 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661ee9 expref: 36 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830616.372154:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e25820ffa00, rc 0) 00000100:00100000:1.0:1788830616.372236:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257fac8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+35:11379:x1875724578392960:12345-192.168.201.21@tcp:101:lfs.0 Request processed in 593us (878us total) trans 4294967431 rc 301/301 00000100:00100000:1.0:1788830616.372243:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 148 00000100:00100000:0.0:1788830616.383220:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830616.383404:0:8202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578393088 00000100:00100000:2.0:1788830616.383419:0:8202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578393088 00000100:00100000:2.0:1788830616.383500:0:8202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 149 00000100:00100000:2.0:1788830616.383512:0:8202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257fac9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+35:11379:x1875724578393088:12345-192.168.201.21@tcp:34:lfs.0 00010000:00010000:2.0:1788830616.383622:0:8202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729a00/0x575506951eea1545 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830616.383643:0:8202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729a00/0x575506951eea1545 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830616.383658:0:8202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729a00/0x575506951eea1545 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830616.383677:0:8202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728e00/0x575506951eea154c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830616.383685:0:8202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728e00/0x575506951eea154c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830616.383749:0:8202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728e00/0x575506951eea154c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830616.383913:0:8202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729400/0x575506951eea1553 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830616.383922:0:8202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729400/0x575506951eea1553 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830616.383930:0:8202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729400/0x575506951eea1553 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788830616.384432:0:8202:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729400/0x575506951eea1553 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830616.384450:0:8202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729a00/0x575506951eea1545 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830616.384457:0:8202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729a00/0x575506951eea1545 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830616.384464:0:8202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729a00/0x575506951eea1545 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830616.384470:0:8202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2565729a00 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:2.0:1788830616.384475:0:8202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729a00/0x575506951eea1545 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830616.384483:0:8202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729a00/0x575506951eea1545 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830616.384499:0:8202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e25530b0b00) 00010000:00010000:2.0:1788830616.384512:0:8202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788830616.384519:0:8202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729a00/0x575506951eea1545 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830616.384525:0:8202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729a00/0x575506951eea1545 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830616.384541:0:8202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728e00/0x575506951eea154c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830616.384546:0:8202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728e00/0x575506951eea154c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830616.384552:0:8202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728e00/0x575506951eea154c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830616.384557:0:8202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2565728e00 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:2.0:1788830616.384560:0:8202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728e00/0x575506951eea154c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830616.384567:0:8202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728e00/0x575506951eea154c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830616.384575:0:8202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9e2551f3ee00) 00010000:00010000:2.0:1788830616.384578:0:8202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788830616.384581:0:8202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728e00/0x575506951eea154c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830616.384587:0:8202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728e00/0x575506951eea154c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830616.384605:0:8202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729400/0x575506951eea1553 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830616.384618:0:8202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729400/0x575506951eea1553 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830616.384623:0:8202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729400/0x575506951eea1553 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830616.384628:0:8202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2565729400 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:2.0:1788830616.384632:0:8202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729400/0x575506951eea1553 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830616.384638:0:8202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729400/0x575506951eea1553 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830616.384647:0:8202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e2551f3e400) 00010000:00010000:2.0:1788830616.384649:0:8202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788830616.384653:0:8202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729400/0x575506951eea1553 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830616.384675:0:8202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729400/0x575506951eea1553 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788830616.384854:0:8202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257fac9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+35:11379:x1875724578393088:12345-192.168.201.21@tcp:34:lfs.0 Request processed in 1332us (1638us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830616.384863:0:8202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 149 00000100:00100000:0.0:1788830616.387956:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830616.389403:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578393344 00000100:00100000:1.0:1788830616.389420:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578393344 00000100:00100000:1.0:1788830616.389828:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 39 00000100:00100000:1.0:1788830616.389843:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257facb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+35:11379:x1875724578393344:12345-192.168.201.21@tcp:35:lfs.0 00000100:00100000:1.0:1788830616.390293:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257facb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+36:11379:x1875724578393344:12345-192.168.201.21@tcp:35:lfs.0 Request processed in 452us (2351us total) trans 4294967432 rc 0/0 00000100:00100000:1.0:1788830616.390302:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 39 00000100:00100000:0.0:1788830616.428248:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830616.428505:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578393600 00000100:00100000:2.0:1788830616.428520:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578393600 00000100:00100000:2.0:1788830616.428610:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 150 00000100:00100000:2.0:1788830616.428623:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257fac8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+36:11382:x1875724578393600:12345-192.168.201.21@tcp:101:lfs.0 00010000:00010000:2.0:1788830616.428658:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788830616.428766:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729400/0x575506951eea155a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa578910534661ef0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830616.428877:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728e00/0x575506951eea1561 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830616.428895:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728e00/0x575506951eea1561 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830616.428911:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728e00/0x575506951eea1561 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830616.428928:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729a00/0x575506951eea1568 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830616.428938:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729a00/0x575506951eea1568 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830616.428957:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729a00/0x575506951eea1568 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830616.429135:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729800/0x575506951eea156f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830616.429146:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729800/0x575506951eea156f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830616.429154:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729800/0x575506951eea156f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788830616.429166:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788830616.429308:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728e00/0x575506951eea1561 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830616.431222:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728e00/0x575506951eea1561 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830616.431240:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728e00/0x575506951eea1561 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830616.431249:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2565728e00 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:2.0:1788830616.431256:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728e00/0x575506951eea1561 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830616.431267:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728e00/0x575506951eea1561 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830616.431294:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e25530b0b00) 00010000:00010000:2.0:1788830616.431299:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788830616.431305:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728e00/0x575506951eea1561 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830616.431311:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728e00/0x575506951eea1561 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830616.432084:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729a00/0x575506951eea1568 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830616.432098:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729a00/0x575506951eea1568 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830616.432106:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729a00/0x575506951eea1568 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830616.432111:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2565729a00 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:2.0:1788830616.432139:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729a00/0x575506951eea1568 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830616.432147:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729a00/0x575506951eea1568 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830616.432159:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9e2551f3ee00) 00010000:00010000:2.0:1788830616.432162:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788830616.432165:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729a00/0x575506951eea1568 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830616.432171:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729a00/0x575506951eea1568 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830616.432262:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729400/0x575506951eea155a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661ef0 expref: 39 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830616.432278:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729800/0x575506951eea156f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661ef0 expref: 38 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830616.432287:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e2551f3e400) 00010000:00010000:2.0:1788830616.432289:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788830616.432292:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2565729800, rc 0) 00000100:00100000:2.0:1788830616.432598:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257fac8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+38:11382:x1875724578393600:12345-192.168.201.21@tcp:101:lfs.0 Request processed in 3975us (4366us total) trans 4294967433 rc 0/0 00000100:00100000:2.0:1788830616.432609:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 150 00000100:00100000:0.0:1788830616.445225:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830616.445321:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578393728 00000100:00100000:3.0:1788830616.445344:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578393728 00000100:00100000:3.0:1788830616.445430:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 151 00000100:00100000:3.0:1788830616.445444:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257facaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+38:11382:x1875724578393728:12345-192.168.201.21@tcp:54:lfs.0 00010000:00010000:3.0:1788830616.445548:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944800/0x575506951eea157d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830616.445570:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944800/0x575506951eea157d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830616.445585:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944800/0x575506951eea157d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830616.445645:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944800/0x575506951eea157d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830616.445653:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944800/0x575506951eea157d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830616.445660:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944800/0x575506951eea157d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830616.445667:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e257d944800 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:3.0:1788830616.445672:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944800/0x575506951eea157d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830616.445682:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944800/0x575506951eea157d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830616.445698:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e2551f3e400) 00010000:00010000:3.0:1788830616.445702:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788830616.445732:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944800/0x575506951eea157d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830616.445740:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944800/0x575506951eea157d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788830616.446030:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257facaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+38:11382:x1875724578393728:12345-192.168.201.21@tcp:54:lfs.0 Request processed in 588us (821us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830616.446040:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 151 00000100:00100000:0.0:1788830616.454414:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830616.454681:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578393984 00000100:00100000:3.0:1788830616.454696:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578393984 00000100:00100000:2.0:1788830616.455306:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 40 00000100:00100000:2.0:1788830616.455320:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257facad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+38:11382:x1875724578393984:12345-192.168.201.21@tcp:35:lfs.0 00000100:00100000:2.0:1788830616.455689:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257facad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+39:11382:x1875724578393984:12345-192.168.201.21@tcp:35:lfs.0 Request processed in 369us (1291us total) trans 4294967434 rc 0/0 00000100:00100000:2.0:1788830616.455763:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 40 00010000:00010000:1.0:1788830616.604033:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788830616.708195:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830616.708357:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578394240 00000100:00100000:3.0:1788830616.708392:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578394240 00000100:00100000:3.0:1788830616.708478:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 152 00000100:00100000:3.0:1788830616.708490:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257f805180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+39:11413:x1875724578394240:12345-192.168.201.21@tcp:101:cat.0 00010000:00010000:3.0:1788830616.708526:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788830616.708555:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944800/0x575506951eea1584 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa578910534661ef7 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830616.708969:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945400/0x575506951eea158b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830616.708987:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945400/0x575506951eea158b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830616.709004:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945400/0x575506951eea158b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788830616.709018:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1788830616.709207:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944800/0x575506951eea1584 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661ef7 expref: 42 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830616.709233:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945400/0x575506951eea158b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661ef7 expref: 41 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830616.709243:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e2551f3e400) 00010000:00010000:3.0:1788830616.709247:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788830616.709251:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e257d945400, rc 0) 00000100:00100000:3.0:1788830616.709338:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257f805180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+41:11413:x1875724578394240:12345-192.168.201.21@tcp:101:cat.0 Request processed in 850us (1158us total) trans 4294967435 rc 0/0 00000100:00100000:3.0:1788830616.709346:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 152 00000100:00100000:0.0:1788830616.712909:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830616.713483:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578394496 00000100:00100000:1.0:1788830616.713499:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578394496 00000100:00100000:1.0:1788830616.713589:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 41 00000100:00100000:1.0:1788830616.713603:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257facb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+41:11413:x1875724578394496:12345-192.168.201.21@tcp:35:cat.0 00000100:00100000:0.0:1788830616.714192:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830616.714350:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578394624 00000100:00100000:2.0:1788830616.714359:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578394624 00000100:00100000:2.0:1788830616.714422:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 12 00000100:00100000:2.0:1788830616.714432:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257fac8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+42:2352:x1875724578394624:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788830616.714448:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788830616.714480:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945400/0x575506951eea158b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661ef7 expref: 42 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830616.714505:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e2551f3e400) 00010000:00010000:2.0:1788830616.714512:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788830616.714592:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257fac8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+42:2352:x1875724578394624:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 160us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830616.714603:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 12 00000100:00100000:1.0:1788830616.714603:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257facb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+42:11413:x1875724578394496:12345-192.168.201.21@tcp:35:cat.0 Request processed in 1001us (1707us total) trans 4294967436 rc 0/0 00000100:00100000:1.0:1788830616.714616:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 41 00000100:00100000:0.0:1788830616.771352:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830616.771552:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578394880 00000100:00100000:3.0:1788830616.771567:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578394880 00000100:00100000:3.0:1788830616.771919:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 153 00000100:00100000:3.0:1788830616.771932:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257fac9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+41:11419:x1875724578394880:12345-192.168.201.21@tcp:101:dd.0 00010000:00010000:3.0:1788830616.771966:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788830616.771970:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788830616.772067:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff400/0x575506951eea14f1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661ecd expref: 41 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830616.772092:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e25530b0b00) 00010000:00010000:3.0:1788830616.772098:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788830616.772117:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944000/0x575506951eea1599 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa578910534661efe expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830616.772349:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944800/0x575506951eea15a0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830616.772368:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729800/0x575506951eea156f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661ef0 expref: 41 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830616.772376:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944800/0x575506951eea15a0 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830616.772422:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729800/0x575506951eea156f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.21@tcp remote: 0xa578910534661ef0 expref: 41 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830616.772515:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729800/0x575506951eea156f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661ef0 expref: 41 pid: 5833 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788830616.772561:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2565499500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5834:1875724595173888:192.168.201.21@tcp:104: 00000100:00100000:3.0:1788830616.772964:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e256578a600 going to sleep for 11 seconds 00000100:00100000:1.0:1788830616.780164:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2565499500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5834:1875724595173888:192.168.201.21@tcp:104: 00010000:00010000:1.0:1788830616.780211:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944800/0x575506951eea15a0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788830616.781593:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830616.781937:0:11161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578395008 00000100:00100000:1.0:1788830616.781950:0:11161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578395008 00010000:00010000:1.0:1788830616.782016:0:11161:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729800/0x575506951eea156f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661ef0 expref: 42 pid: 5833 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788830616.782066:0:11161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 65 00000100:00100000:1.0:1788830616.782080:0:11161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257fac9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+42:2355:x1875724578395008:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788830616.782101:0:11161:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788830616.782110:0:11161:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729800/0x575506951eea156f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661ef0 expref: 42 pid: 5833 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830616.782126:0:11161:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729800/0x575506951eea156f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661ef0 expref: 42 pid: 5833 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830616.782156:0:11161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729800/0x575506951eea156f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661ef0 expref: 42 pid: 5833 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830616.782176:0:11161:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e2551f3e400) 00010000:00010000:1.0:1788830616.782183:0:11161:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944800/0x575506951eea15a0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830616.782195:0:11161:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944800/0x575506951eea15a0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830616.782205:0:11161:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944800/0x575506951eea15a0 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830616.782247:0:11161:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788830616.782328:0:11161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257fac9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+41:2355:x1875724578395008:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 250us (745us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830616.782337:0:11161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 65 00010000:00010000:3.0:1788830616.782548:0:5834:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944800/0x575506951eea15a0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830616.782557:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944800/0x575506951eea15a0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788830616.782582:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1788830616.782860:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944000/0x575506951eea1599 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661efe expref: 42 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830616.782879:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944800/0x575506951eea15a0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661efe expref: 41 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830616.782887:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e2551f3e400) 00010000:00010000:3.0:1788830616.782890:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788830616.782892:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e257d944800, rc 0) 00000100:00100000:3.0:1788830616.782926:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257fac9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+41:11419:x1875724578394880:12345-192.168.201.21@tcp:101:dd.0 Request processed in 10999us (11592us total) trans 4294967437 rc 0/0 00000100:00100000:3.0:1788830616.782934:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 153 00000100:00100000:3.0:1788830616.791145:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830616.791336:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578395264 00000100:00100000:2.0:1788830616.791349:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578395264 00000100:00100000:2.0:1788830616.791422:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 154 00000100:00100000:2.0:1788830616.791435:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e256549b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+41:11419:x1875724578395264:12345-192.168.201.21@tcp:36:dd.0 00010000:00010000:2.0:1788830616.791895:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728e00/0x575506951eea15ae lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830616.791918:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728e00/0x575506951eea15ae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830616.791932:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728e00/0x575506951eea15ae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788830616.792035:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967438 00000004:00010000:2.0:1788830616.792065:0:5833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000062914ab9 reply state 00000000fb1aee55 transno 4294967439 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728e00/0x575506951eea15ae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788830616.792075:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788830616.792204:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e256549b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+44:11419:x1875724578395264:12345-192.168.201.21@tcp:36:dd.0 Request processed in 770us (1074us total) trans 4294967439 rc 0/0 00000100:00100000:2.0:1788830616.792213:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 154 00000020:00080000:2.0:1788830616.792219:0:5833:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788830616.794795:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728e00/0x575506951eea15ae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830616.794828:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728e00/0x575506951eea15ae lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830616.794836:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728e00/0x575506951eea15ae lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830616.794841:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2565728e00 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:1.0:1788830616.794846:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728e00/0x575506951eea15ae lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830616.794854:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728e00/0x575506951eea15ae lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830616.794876:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e2551f3e400) 00010000:00010000:1.0:1788830616.794879:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788830616.794884:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728e00/0x575506951eea15ae lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830616.794890:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728e00/0x575506951eea15ae lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788830616.865231:0:7646:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00000001:00080000:2.0:1788830616.865258:0:7646:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000100:00100000:3.0:1788830617.151512:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830617.156090:0:8202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578395392 00000100:00100000:0.0:1788830617.156112:0:8202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578395392 00000100:00100000:0.0:1788830617.156196:0:8202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 155 00000100:00100000:0.0:1788830617.156221:0:8202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2565499500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+43:11433:x1875724578395392:12345-192.168.201.21@tcp:101:stat.0 00010000:00010000:0.0:1788830617.156248:0:8202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788830617.156271:0:8202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e400/0x575506951eea15b5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa578910534661f05 expref: -99 pid: 8202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830617.156353:0:8202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea15bc lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830617.156369:0:8202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea15bc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830617.156383:0:8202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea15bc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830617.156399:0:8202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f000/0x575506951eea15c3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830617.156405:0:8202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f000/0x575506951eea15c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830617.156413:0:8202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f000/0x575506951eea15c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830617.156500:0:8202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea15ca lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830617.156512:0:8202:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944800/0x575506951eea15a0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661efe expref: 44 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830617.156529:0:8202:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea15ca lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830617.156573:0:8202:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944800/0x575506951eea15a0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.21@tcp remote: 0xa578910534661efe expref: 44 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830617.156587:0:8202:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944800/0x575506951eea15a0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661efe expref: 44 pid: 5834 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788830617.156602:0:8202:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257facb100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8202:1875724595174016:192.168.201.21@tcp:104: 00000100:00100000:0.0:1788830617.157017:0:8202:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2549995480 going to sleep for 11 seconds 00000100:00100000:2.0:1788830617.162760:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830617.162945:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578395648 00000100:00100000:1.0:1788830617.162956:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578395648 00000100:00100000:1.0:1788830617.163022:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 42 00000100:00100000:1.0:1788830617.163035:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2565cc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+45:5590:x1875724578395648:12345-192.168.201.21@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788830617.163597:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2565cc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+46:5590:x1875724578395648:12345-192.168.201.21@tcp:35:ldlm_bl.0 Request processed in 563us (896us total) trans 4294967440 rc 0/0 00000100:00100000:1.0:1788830617.163607:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 42 00000100:00100000:0.0:1788830617.163768:0:8202:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257facb100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8202:1875724595174016:192.168.201.21@tcp:104: 00010000:00010000:0.0:1788830617.163794:0:8202:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea15ca lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788830617.169777:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830617.170761:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578395776 00000100:00100000:0.0:1788830617.170777:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578395776 00010000:00010000:0.0:1788830617.170831:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944800/0x575506951eea15a0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661efe expref: 46 pid: 5834 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788830617.170883:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 66 00000100:00100000:0.0:1788830617.170894:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257e924700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+46:2354:x1875724578395776:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788830617.170909:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788830617.170917:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944800/0x575506951eea15a0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661efe expref: 46 pid: 5834 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830617.170930:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944800/0x575506951eea15a0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661efe expref: 46 pid: 5834 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830617.170976:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944800/0x575506951eea15a0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661efe expref: 46 pid: 5834 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830617.170994:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e2551f3e400) 00010000:00010000:0.0:1788830617.171000:0:5819:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea15ca lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830617.171010:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea15ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830617.171018:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea15ca lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830617.171057:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788830617.171128:0:8202:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea15ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788830617.171143:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257e924700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+45:2354:x1875724578395776:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 247us (1379us total) trans 0 rc 0/0 00010000:00010000:2.0:1788830617.171166:0:8202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea15ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788830617.171169:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 66 00000004:00200000:2.0:1788830617.171247:0:8202:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1788830617.171254:0:8202:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788830617.171289:0:8202:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea15ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830617.171321:0:8202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea15ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830617.171333:0:8202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea15bc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830617.171339:0:8202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea15bc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830617.171360:0:8202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea15bc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830617.171366:0:8202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2445b7f800 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:2.0:1788830617.171372:0:8202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea15bc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830617.171380:0:8202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea15bc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830617.171396:0:8202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e25530b0b00) 00010000:00010000:2.0:1788830617.171399:0:8202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788830617.171405:0:8202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea15bc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830617.171412:0:8202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea15bc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830617.171566:0:8202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f000/0x575506951eea15c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830617.171576:0:8202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f000/0x575506951eea15c3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830617.171583:0:8202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f000/0x575506951eea15c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830617.171588:0:8202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2445b7f000 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:2.0:1788830617.171592:0:8202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f000/0x575506951eea15c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830617.171610:0:8202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f000/0x575506951eea15c3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830617.171696:0:8202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9e25518dcf00) 00010000:00010000:2.0:1788830617.171698:0:8202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788830617.171701:0:8202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f000/0x575506951eea15c3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830617.171770:0:8202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f000/0x575506951eea15c3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830617.173567:0:8202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e400/0x575506951eea15b5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661f05 expref: 45 pid: 8202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830617.173603:0:8202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea15ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661f05 expref: 44 pid: 8202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830617.174054:0:8202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e2551f3e400) 00010000:00010000:2.0:1788830617.174061:0:8202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788830617.174065:0:8202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2445b7ee00, rc 0) 00000100:00100000:2.0:1788830617.174168:0:8202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2565499500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+44:11433:x1875724578395392:12345-192.168.201.21@tcp:101:stat.0 Request processed in 17946us (22662us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830617.174180:0:8202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 155 00000100:00100000:2.0:1788830617.233466:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830617.233798:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578396032 00000100:00100000:1.0:1788830617.233812:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578396032 00000100:00100000:1.0:1788830617.233889:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 156 00000100:00100000:1.0:1788830617.233903:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25478b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+44:11439:x1875724578396032:12345-192.168.201.21@tcp:36:truncate.0 00010000:00010000:1.0:1788830617.233975:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788830617.234007:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea15ca lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661f05 expref: 44 pid: 8202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830617.234027:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e2551f3e400) 00010000:00010000:1.0:1788830617.234042:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788830617.234658:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff400/0x575506951eea15d1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830617.234677:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff400/0x575506951eea15d1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830617.234690:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff400/0x575506951eea15d1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788830617.235179:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967441 00000004:00010000:1.0:1788830617.235212:0:5833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000131cf8e4 reply state 0000000041666687 transno 4294967442 ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff400/0x575506951eea15d1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788830617.235223:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788830617.235376:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25478b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+46:11439:x1875724578396032:12345-192.168.201.21@tcp:36:truncate.0 Request processed in 1472us (1922us total) trans 4294967442 rc 0/0 00000100:00100000:1.0:1788830617.235405:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 156 00000020:00080000:1.0:1788830617.235413:0:5833:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788830617.240001:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff400/0x575506951eea15d1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830617.240025:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff400/0x575506951eea15d1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830617.240034:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff400/0x575506951eea15d1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830617.240040:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e25820ff400 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:0.0:1788830617.240045:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff400/0x575506951eea15d1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830617.240076:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff400/0x575506951eea15d1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830617.240108:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e2551f3e400) 00010000:00010000:0.0:1788830617.240112:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788830617.240125:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff400/0x575506951eea15d1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830617.240133:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff400/0x575506951eea15d1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788830617.314091:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e255130ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875724595174144:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788830617.314230:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830617.315635:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595174144 00000100:00100000:1.0:1788830617.315657:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595174144 00000100:00080000:3.0:1788830617.315810:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788830617.320753:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788830617.320798:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25658c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875724595174144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788830617.320857:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788830617.320978:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25658c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875724595174144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 207us (6749us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830617.320986:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788830617.321608:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e255130ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875724595174144:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788830617.407381:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830617.407526:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578396160 00000100:00100000:3.0:1788830617.407548:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578396160 00000100:00100000:3.0:1788830617.407658:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 157 00000100:00100000:3.0:1788830617.407671:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25658c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+45:11453:x1875724578396160:12345-192.168.201.21@tcp:101:stat.0 00010000:00010000:3.0:1788830617.407705:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788830617.407784:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944800/0x575506951eea15d8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa578910534661f0c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830617.407883:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944000/0x575506951eea15df lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830617.407901:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944000/0x575506951eea15df lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830617.407915:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944000/0x575506951eea15df lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830617.407935:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945400/0x575506951eea15e6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830617.407942:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945400/0x575506951eea15e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830617.407949:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945400/0x575506951eea15e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830617.408323:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944200/0x575506951eea15ed lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830617.408334:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944200/0x575506951eea15ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830617.408342:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944200/0x575506951eea15ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788830617.408394:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:3.0:1788830617.408399:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788830617.408422:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944200/0x575506951eea15ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830617.408816:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944200/0x575506951eea15ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830617.408826:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944000/0x575506951eea15df lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830617.408832:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944000/0x575506951eea15df lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830617.408839:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944000/0x575506951eea15df lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830617.408845:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e257d944000 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:3.0:1788830617.408850:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944000/0x575506951eea15df lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830617.408858:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944000/0x575506951eea15df lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830617.408874:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e25530b0b00) 00010000:00010000:3.0:1788830617.408877:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788830617.408882:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944000/0x575506951eea15df lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830617.408889:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944000/0x575506951eea15df lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830617.408920:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945400/0x575506951eea15e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830617.408928:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945400/0x575506951eea15e6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830617.408933:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945400/0x575506951eea15e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830617.408939:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e257d945400 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:3.0:1788830617.408942:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945400/0x575506951eea15e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830617.408948:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945400/0x575506951eea15e6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830617.408957:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9e25530b0f00) 00010000:00010000:3.0:1788830617.408959:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788830617.408963:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945400/0x575506951eea15e6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830617.408969:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945400/0x575506951eea15e6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830617.409013:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944800/0x575506951eea15d8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661f0c expref: 47 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830617.409028:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944200/0x575506951eea15ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661f0c expref: 46 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830617.409048:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e2551f3e400) 00010000:00010000:3.0:1788830617.409050:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788830617.409053:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e257d944200, rc 0) 00000100:00100000:3.0:1788830617.409553:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25658c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+46:11453:x1875724578396160:12345-192.168.201.21@tcp:101:stat.0 Request processed in 1882us (2185us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830617.409560:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 157 00000001:00080000:1.0:1788830617.414544:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967427 is committed 00000020:00080000:1.0:1788830617.414560:0:5855:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9e2545cc9e40 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:1.0:1788830617.414566:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9e256568df00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9e2545cc93c0 00000020:00080000:1.0:1788830617.414569:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9e256568d900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9e25656ce000 00000001:00080000:1.0:1788830617.414595:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967442 is committed 00000004:00080000:1.0:1788830617.414626:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:2.0:1788830617.414749:0:5866:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:2.0:1788830617.415085:0:5866:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:1.0:1788830617.415152:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788830617.415181:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e256549aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875724595174272:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788830617.415257:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830617.415521:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595174272 00000100:00100000:3.0:1788830617.415529:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595174272 00000100:00100000:3.0:1788830617.415585:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788830617.415596:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255130ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875724595174272:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788830617.415624:0:6677:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:4 count 1 00002000:00010000:3.0:1788830617.415766:0:6677:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a9f6397, atime: 0x6a9f6397, ctime: 0x6a9f6397, blocks: 0xb 00010000:00010000:3.0:1788830617.415776:0:6677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005adfe4de/0x575506951eea15f4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830617.415794:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=370s v=(0 0) 00010000:00010000:3.0:1788830617.415798:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788830617.415805:0:6677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005adfe4de/0x575506951eea15f4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830617.415823:0:6677:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005adfe4de/0x575506951eea15f4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830617.415833:0:6677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005adfe4de/0x575506951eea15f4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830617.415860:0:6677:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005adfe4de/0x575506951eea15f4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830617.415884:0:6677:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788830617.415951:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788830617.415964:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005adfe4de/0x575506951eea15f4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830617.415978:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e257d945c00 already unused, calling callback (ffffffffc14cb350) 00010000:00010000:2.0:1788830617.415984:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005adfe4de/0x575506951eea15f4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830617.415998:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005adfe4de/0x575506951eea15f4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830617.416030:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005adfe4de/0x575506951eea15f4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830617.416038:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005adfe4de/0x575506951eea15f4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830617.416072:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788830617.416075:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788830617.416077:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788830617.417038:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255130ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3307:x1875724595174272:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1439us (1775us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1788830617.417050:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788830617.419927:0:3307:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967306 gen 2 00000004:00080000:2.0:1788830617.419940:0:3307:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967306 00000100:00100000:2.0:1788830617.419969:0:3307:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9e256549aa00 x1875724595174272/t4294967307(4294967307) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788830633 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1788830617.419982:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e256549aa00/2, rc 0, transno 4294967307 00000100:00100000:2.0:1788830617.419987:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e256549aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875724595174272:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788830617.516106:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830617.516222:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578396416 00000100:00100000:1.0:1788830617.516233:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578396416 00000100:00100000:1.0:1788830617.516301:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 158 00000100:00100000:1.0:1788830617.516313:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2565498e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+16:11463:x1875724578396416:12345-192.168.201.21@tcp:101:lfs.0 00010000:00010000:1.0:1788830617.516336:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788830617.516359:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffa00/0x575506951eea15fb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa578910534661f13 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788830617.516475:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1788830617.516912:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffa00/0x575506951eea15fb lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661f13 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830617.517052:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e257480c400) 00010000:00010000:1.0:1788830617.517057:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788830617.517063:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffa00/0x575506951eea15fb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661f13 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830617.517079:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e25820ffa00, rc 0) 00000100:00100000:1.0:1788830617.517179:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2565498e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+17:11463:x1875724578396416:12345-192.168.201.21@tcp:101:lfs.0 Request processed in 868us (1083us total) trans 4294967443 rc 301/301 00000100:00100000:1.0:1788830617.517187:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 158 00000100:00100000:2.0:1788830617.535189:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830617.535304:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578396672 00000100:00100000:1.0:1788830617.535315:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578396672 00000100:00100000:1.0:1788830617.535381:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 43 00000100:00100000:1.0:1788830617.535392:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25629b1050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+17:11463:x1875724578396672:12345-192.168.201.21@tcp:35:lfs.0 00000100:00100000:1.0:1788830617.535645:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25629b1050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+18:11463:x1875724578396672:12345-192.168.201.21@tcp:35:lfs.0 Request processed in 254us (465us total) trans 4294967444 rc 0/0 00000100:00100000:1.0:1788830617.535653:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 43 00000100:00100000:2.0:1788830617.593304:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830617.593434:0:8202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578396928 00000100:00100000:1.0:1788830617.593446:0:8202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578396928 00000100:00100000:1.0:1788830617.593516:0:8202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 159 00000100:00100000:1.0:1788830617.593529:0:8202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25658c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+18:11469:x1875724578396928:12345-192.168.201.21@tcp:101:bash.0 00010000:00010000:1.0:1788830617.593563:0:8202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788830617.593612:0:8202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffa00/0x575506951eea1609 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa578910534661f1a expref: -99 pid: 8202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830617.593820:0:8202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea1610 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830617.593840:0:8202:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944200/0x575506951eea15ed lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661f0c expref: 19 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830617.593850:0:8202:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea1610 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830617.593896:0:8202:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944200/0x575506951eea15ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.21@tcp remote: 0xa578910534661f0c expref: 19 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830617.593916:0:8202:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944200/0x575506951eea15ed lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661f0c expref: 19 pid: 5834 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788830617.593935:0:8202:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257f804e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8202:1875724595174400:192.168.201.21@tcp:104: 00000100:00100000:1.0:1788830617.594069:0:8202:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2548317480 going to sleep for 11 seconds 00000100:00100000:3.0:1788830617.598438:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830617.598533:0:11161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578397056 00000100:00100000:0.0:1788830617.598544:0:11161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578397056 00010000:00010000:0.0:1788830617.598594:0:11161:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944200/0x575506951eea15ed lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661f0c expref: 20 pid: 5834 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788830617.598644:0:11161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 67 00000100:00100000:0.0:1788830617.598652:0:11161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2544ee4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+20:2355:x1875724578397056:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788830617.598666:0:11161:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788830617.598672:0:11161:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944200/0x575506951eea15ed lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661f0c expref: 20 pid: 5834 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830617.598684:0:11161:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944200/0x575506951eea15ed lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661f0c expref: 20 pid: 5834 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830617.598756:0:11161:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e2551f3e400) 00010000:00010000:0.0:1788830617.598764:0:11161:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea1610 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830617.598788:0:11161:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea1610 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830617.598797:0:11161:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea1610 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830617.598824:0:11161:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788830617.598896:0:11161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2544ee4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+20:2355:x1875724578397056:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 244us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830617.598902:0:11161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 67 00010000:00010000:1.0:1788830617.599588:0:8202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944200/0x575506951eea15ed lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661f0c expref: 19 pid: 5834 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788830617.599618:0:8202:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257f804e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8202:1875724595174400:192.168.201.21@tcp:104: 00010000:00010000:1.0:1788830617.599642:0:8202:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea1610 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830617.599650:0:8202:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea1610 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830617.599667:0:8202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea1610 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788830617.599688:0:8202:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:1.0:1788830617.599950:0:8202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffa00/0x575506951eea1609 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661f1a expref: 20 pid: 8202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830617.599964:0:8202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea1610 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661f1a expref: 19 pid: 8202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830617.599971:0:8202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e2551f3e400) 00010000:00010000:1.0:1788830617.599974:0:8202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788830617.599976:0:8202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e25820ff800, rc 0) 00000100:00100000:1.0:1788830617.600031:0:8202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25658c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+19:11469:x1875724578396928:12345-192.168.201.21@tcp:101:bash.0 Request processed in 6506us (6751us total) trans 4294967445 rc 0/0 00000100:00100000:1.0:1788830617.600036:0:8202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 159 00000100:00100000:0.0:1788830617.608459:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830617.608564:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578397312 00000100:00100000:2.0:1788830617.608578:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578397312 00000100:00100000:2.0:1788830617.608670:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 160 00000100:00100000:2.0:1788830617.608683:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257facb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+19:11469:x1875724578397312:12345-192.168.201.21@tcp:36:bash.0 00010000:00010000:2.0:1788830617.609298:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729a00/0x575506951eea161e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830617.609321:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729a00/0x575506951eea161e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830617.609336:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729a00/0x575506951eea161e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788830617.609407:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967446 00000004:00010000:2.0:1788830617.609436:0:5833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f52135a0 reply state 00000000fdb75647 transno 4294967447 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729a00/0x575506951eea161e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788830617.609446:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788830617.609579:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257facb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+22:11469:x1875724578397312:12345-192.168.201.21@tcp:36:bash.0 Request processed in 897us (1134us total) trans 4294967447 rc 0/0 00000100:00100000:2.0:1788830617.609588:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 160 00000020:00080000:2.0:1788830617.609594:0:5833:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788830617.614030:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729a00/0x575506951eea161e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830617.614058:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729a00/0x575506951eea161e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830617.614067:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729a00/0x575506951eea161e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830617.614075:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2565729a00 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:1.0:1788830617.614081:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729a00/0x575506951eea161e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830617.614180:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729a00/0x575506951eea161e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830617.614206:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e2551f3e400) 00010000:00010000:1.0:1788830617.614210:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788830617.614216:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729a00/0x575506951eea161e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830617.614223:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729a00/0x575506951eea161e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788830617.620019:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830617.620582:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578397440 00000100:00100000:3.0:1788830617.620596:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578397440 00000100:00100000:3.0:1788830617.621069:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 161 00000100:00100000:3.0:1788830617.621083:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257fac8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+21:11469:x1875724578397440:12345-192.168.201.21@tcp:101:bash.0 00010000:00010000:3.0:1788830617.621131:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788830617.621162:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944800/0x575506951eea1625 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa578910534661f21 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830617.621318:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945400/0x575506951eea162c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830617.621338:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea1610 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661f1a expref: 22 pid: 8202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830617.621348:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945400/0x575506951eea162c lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830617.621400:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea1610 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.21@tcp remote: 0xa578910534661f1a expref: 22 pid: 8202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830617.621440:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea1610 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661f1a expref: 22 pid: 8202 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788830617.621458:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2544ee5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5834:1875724595174528:192.168.201.21@tcp:104: 00000100:00100000:3.0:1788830617.621585:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e25461a5d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788830617.625111:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830617.625258:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2544ee5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5834:1875724595174528:192.168.201.21@tcp:104: 00010000:00010000:3.0:1788830617.625296:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945400/0x575506951eea162c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788830617.625436:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578397568 00000100:00100000:0.0:1788830617.625447:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578397568 00010000:00010000:0.0:1788830617.625495:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea1610 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661f1a expref: 23 pid: 8202 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788830617.625545:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 68 00000100:00100000:0.0:1788830617.625556:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25658c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+23:2355:x1875724578397568:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788830617.625578:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788830617.625585:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea1610 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661f1a expref: 23 pid: 8202 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830617.625600:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea1610 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661f1a expref: 23 pid: 8202 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830617.625639:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea1610 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661f1a expref: 23 pid: 8202 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830617.625675:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e2551f3e400) 00010000:00010000:0.0:1788830617.625681:0:5819:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945400/0x575506951eea162c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830617.625693:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945400/0x575506951eea162c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830617.625701:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945400/0x575506951eea162c lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830617.625803:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788830617.625870:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25658c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+22:2355:x1875724578397568:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 316us (778us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830617.625878:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 68 00010000:00010000:2.0:1788830617.626473:0:5834:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945400/0x575506951eea162c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830617.626484:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945400/0x575506951eea162c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788830617.626562:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1788830617.626568:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788830617.626597:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945400/0x575506951eea162c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830617.626650:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944800/0x575506951eea1625 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661f21 expref: 22 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830617.626672:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945400/0x575506951eea162c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661f21 expref: 21 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830617.626682:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e2551f3e400) 00010000:00010000:2.0:1788830617.626685:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788830617.626688:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e257d945400, rc 0) 00000100:00100000:2.0:1788830617.626852:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257fac8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+21:11469:x1875724578397440:12345-192.168.201.21@tcp:101:bash.0 Request processed in 5772us (6855us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830617.626861:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 161 00010000:00010000:1.0:1788830617.634001:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788830617.639553:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830617.639771:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578397824 00000100:00100000:1.0:1788830617.639786:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578397824 00000100:00100000:1.0:1788830617.639903:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 44 00000100:00100000:1.0:1788830617.639916:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25658c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+21:11469:x1875724578397824:12345-192.168.201.21@tcp:35:bash.0 00000100:00100000:1.0:1788830617.640237:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25658c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+22:11469:x1875724578397824:12345-192.168.201.21@tcp:35:bash.0 Request processed in 322us (764us total) trans 4294967448 rc 0/0 00000100:00100000:1.0:1788830617.640246:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 44 00000100:00100000:2.0:1788830617.738913:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830617.739041:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578398080 00000100:00100000:1.0:1788830617.739054:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578398080 00000100:00100000:1.0:1788830617.739156:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 162 00000100:00100000:1.0:1788830617.739170:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25658c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+22:11479:x1875724578398080:12345-192.168.201.21@tcp:101:lfs.0 00010000:00010000:1.0:1788830617.739205:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788830617.739234:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffa00/0x575506951eea1633 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa578910534661f28 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788830617.739403:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1788830617.739583:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffa00/0x575506951eea1633 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661f28 expref: 24 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830617.739614:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e257480c400) 00010000:00010000:1.0:1788830617.739619:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788830617.739625:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffa00/0x575506951eea1633 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661f28 expref: 24 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830617.739645:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e25820ffa00, rc 0) 00000100:00100000:1.0:1788830617.739805:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25658c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+23:11479:x1875724578398080:12345-192.168.201.21@tcp:101:lfs.0 Request processed in 638us (907us total) trans 4294967449 rc 301/301 00000100:00100000:1.0:1788830617.739814:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 162 00000100:00100000:0.0:1788830617.743593:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830617.743700:0:8202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578398208 00000100:00100000:1.0:1788830617.743755:0:8202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578398208 00000100:00100000:1.0:1788830617.743834:0:8202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 163 00000100:00100000:1.0:1788830617.743845:0:8202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257faca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+23:11479:x1875724578398208:12345-192.168.201.21@tcp:34:lfs.0 00010000:00010000:1.0:1788830617.743968:0:8202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea1641 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830617.743993:0:8202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea1641 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830617.744014:0:8202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea1641 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830617.744033:0:8202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff400/0x575506951eea1648 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830617.744040:0:8202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff400/0x575506951eea1648 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830617.744067:0:8202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff400/0x575506951eea1648 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830617.744461:0:8202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8c800/0x575506951eea164f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830617.744472:0:8202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8c800/0x575506951eea164f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830617.744480:0:8202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8c800/0x575506951eea164f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788830617.744535:0:8202:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8c800/0x575506951eea164f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830617.744552:0:8202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea1641 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830617.744559:0:8202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea1641 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830617.744567:0:8202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea1641 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830617.744574:0:8202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e25820ff800 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:1.0:1788830617.744579:0:8202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea1641 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830617.744588:0:8202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea1641 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830617.744602:0:8202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e25530b0b00) 00010000:00010000:1.0:1788830617.744613:0:8202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788830617.744620:0:8202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea1641 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830617.744627:0:8202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea1641 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830617.744645:0:8202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff400/0x575506951eea1648 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830617.744651:0:8202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff400/0x575506951eea1648 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830617.744658:0:8202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff400/0x575506951eea1648 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830617.744663:0:8202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e25820ff400 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:1.0:1788830617.744666:0:8202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff400/0x575506951eea1648 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830617.744673:0:8202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff400/0x575506951eea1648 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830617.744682:0:8202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9e257480c900) 00010000:00010000:1.0:1788830617.744684:0:8202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788830617.744688:0:8202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff400/0x575506951eea1648 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830617.744694:0:8202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff400/0x575506951eea1648 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830617.744770:0:8202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8c800/0x575506951eea164f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830617.744784:0:8202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8c800/0x575506951eea164f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830617.744791:0:8202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8c800/0x575506951eea164f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830617.744797:0:8202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e257fa8c800 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:1.0:1788830617.744801:0:8202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8c800/0x575506951eea164f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830617.744807:0:8202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8c800/0x575506951eea164f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830617.744816:0:8202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e2551f3e400) 00010000:00010000:1.0:1788830617.744819:0:8202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788830617.744822:0:8202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8c800/0x575506951eea164f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830617.744828:0:8202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8c800/0x575506951eea164f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788830617.745426:0:8202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257faca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+23:11479:x1875724578398208:12345-192.168.201.21@tcp:34:lfs.0 Request processed in 1575us (1842us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830617.745438:0:8202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 163 00000100:00100000:3.0:1788830617.749359:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830617.749487:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578398464 00000100:00100000:2.0:1788830617.749502:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578398464 00000100:00100000:2.0:1788830617.749580:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 45 00000100:00100000:2.0:1788830617.749593:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2544ee5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+23:11479:x1875724578398464:12345-192.168.201.21@tcp:35:lfs.0 00000100:00100000:2.0:1788830617.749996:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2544ee5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+24:11479:x1875724578398464:12345-192.168.201.21@tcp:35:lfs.0 Request processed in 404us (651us total) trans 4294967450 rc 0/0 00000100:00100000:2.0:1788830617.750005:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 45 00000100:00100000:3.0:1788830617.783553:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830617.783633:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578398720 00000100:00100000:1.0:1788830617.783648:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578398720 00000100:00100000:1.0:1788830617.783772:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 164 00000100:00100000:1.0:1788830617.783786:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2544ee7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+24:11482:x1875724578398720:12345-192.168.201.21@tcp:101:lfs.0 00010000:00010000:1.0:1788830617.783820:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788830617.783870:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8c800/0x575506951eea1656 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa578910534661f2f expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830617.783974:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8ce00/0x575506951eea165d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830617.783993:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8ce00/0x575506951eea165d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830617.784007:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8ce00/0x575506951eea165d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830617.784024:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8d000/0x575506951eea1664 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830617.784031:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8d000/0x575506951eea1664 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830617.784038:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8d000/0x575506951eea1664 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830617.784867:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8d600/0x575506951eea166b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830617.784878:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8d600/0x575506951eea166b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830617.784886:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8d600/0x575506951eea166b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788830617.784894:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1788830617.784993:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8ce00/0x575506951eea165d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830617.785007:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8ce00/0x575506951eea165d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830617.785012:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8ce00/0x575506951eea165d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830617.785017:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e257fa8ce00 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:1.0:1788830617.785021:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8ce00/0x575506951eea165d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830617.785027:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8ce00/0x575506951eea165d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830617.785039:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e25530b0b00) 00010000:00010000:1.0:1788830617.785041:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788830617.785044:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8ce00/0x575506951eea165d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830617.785048:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8ce00/0x575506951eea165d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830617.785060:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8d000/0x575506951eea1664 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830617.785064:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8d000/0x575506951eea1664 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830617.785068:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8d000/0x575506951eea1664 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830617.785071:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e257fa8d000 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:1.0:1788830617.785076:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8d000/0x575506951eea1664 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830617.785081:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8d000/0x575506951eea1664 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830617.785086:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9e257480c900) 00010000:00010000:1.0:1788830617.785087:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788830617.785088:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8d000/0x575506951eea1664 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830617.785092:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8d000/0x575506951eea1664 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830617.785145:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8c800/0x575506951eea1656 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661f2f expref: 27 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830617.785161:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8d600/0x575506951eea166b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661f2f expref: 26 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830617.785168:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e2551f3e400) 00010000:00010000:1.0:1788830617.785171:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788830617.785173:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e257fa8d600, rc 0) 00000100:00100000:1.0:1788830617.785278:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2544ee7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+26:11482:x1875724578398720:12345-192.168.201.21@tcp:101:lfs.0 Request processed in 1490us (1736us total) trans 4294967451 rc 0/0 00000100:00100000:1.0:1788830617.785287:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 164 00000100:00100000:0.0:1788830617.790263:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830617.790445:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830617.790524:0:11161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578398976 00000100:00100000:1.0:1788830617.790537:0:11161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578398976 00000100:00100000:1.0:1788830617.790625:0:11161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 13 00000100:00100000:1.0:1788830617.790636:0:11161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257facad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+26:2355:x1875724578398976:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788830617.790674:0:11161:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788830617.790705:0:11161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8d600/0x575506951eea166b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661f2f expref: 26 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830617.790778:0:11161:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e2551f3e400) 00010000:00010000:1.0:1788830617.790783:0:11161:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788830617.790856:0:11161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257facad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+25:2355:x1875724578398976:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 222us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830617.790864:0:11161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 13 00000100:00100000:2.0:1788830617.794180:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578398848 00000100:00100000:2.0:1788830617.794205:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578398848 00000100:00100000:2.0:1788830617.794904:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 165 00000100:00100000:2.0:1788830617.794922:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257facb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+25:11482:x1875724578398848:12345-192.168.201.21@tcp:54:lfs.0 00010000:00010000:2.0:1788830617.795018:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729000/0x575506951eea1679 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830617.795040:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729000/0x575506951eea1679 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830617.795056:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729000/0x575506951eea1679 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830617.795101:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729000/0x575506951eea1679 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830617.795118:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729000/0x575506951eea1679 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830617.795126:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729000/0x575506951eea1679 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830617.795132:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2565729000 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:2.0:1788830617.795138:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729000/0x575506951eea1679 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830617.795147:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729000/0x575506951eea1679 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830617.795163:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e2551f3e400) 00010000:00010000:2.0:1788830617.795166:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788830617.795172:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729000/0x575506951eea1679 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830617.795198:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729000/0x575506951eea1679 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788830617.795329:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257facb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+25:11482:x1875724578398848:12345-192.168.201.21@tcp:54:lfs.0 Request processed in 412us (5084us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830617.795339:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 165 00000100:00100000:0.0:1788830617.798573:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830617.798695:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578399232 00000100:00100000:2.0:1788830617.798864:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578399232 00000100:00100000:2.0:1788830617.798947:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 46 00000100:00100000:2.0:1788830617.798960:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257facb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+25:11482:x1875724578399232:12345-192.168.201.21@tcp:35:lfs.0 00000100:00100000:2.0:1788830617.799339:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257facb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+26:11482:x1875724578399232:12345-192.168.201.21@tcp:35:lfs.0 Request processed in 380us (780us total) trans 4294967452 rc 0/0 00000100:00100000:2.0:1788830617.799348:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 46 00000100:00100000:3.0:1788830617.974972:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830617.975089:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578399488 00000100:00100000:2.0:1788830617.975104:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578399488 00000100:00100000:2.0:1788830617.975182:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 166 00000100:00100000:2.0:1788830617.975196:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2544ee4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+26:11500:x1875724578399488:12345-192.168.201.21@tcp:101:cat.0 00010000:00010000:2.0:1788830617.975232:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788830617.975262:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729000/0x575506951eea1680 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa578910534661f36 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830617.975401:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729400/0x575506951eea1687 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830617.975432:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729400/0x575506951eea1687 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830617.975476:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729400/0x575506951eea1687 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788830617.975492:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1788830617.975818:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729000/0x575506951eea1680 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661f36 expref: 29 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830617.975843:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729400/0x575506951eea1687 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661f36 expref: 28 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830617.975854:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e2551f3e400) 00010000:00010000:2.0:1788830617.975857:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788830617.975861:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2565729400, rc 0) 00000100:00100000:2.0:1788830617.976075:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2544ee4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+28:11500:x1875724578399488:12345-192.168.201.21@tcp:101:cat.0 Request processed in 881us (1119us total) trans 4294967453 rc 0/0 00000100:00100000:2.0:1788830617.976083:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 166 00000100:00100000:1.0:1788830617.993305:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830617.993361:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830617.993407:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830617.993451:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830617.993541:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578399616 00000100:00100000:3.0:1788830617.993554:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578399616 00000100:00100000:3.0:1788830617.993638:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 291 00000100:00100000:3.0:1788830617.993650:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255d949050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+13:2355:x1875724578399616:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:3.0:1788830617.993802:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255d949050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+13:2355:x1875724578399616:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 153us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830617.993810:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 291 00000100:00100000:3.0:1788830617.993855:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578399744 00000100:00100000:3.0:1788830617.993859:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578399744 00000100:00100000:3.0:1788830617.993900:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578399872 00000100:00100000:3.0:1788830617.993903:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578399872 00000100:00100000:3.0:1788830617.993924:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 85 00000100:00100000:3.0:1788830617.993931:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257f804e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+6:2355:x1875724578399744:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:3.0:1788830617.993986:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257f804e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+6:2355:x1875724578399744:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 56us (698us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830617.993994:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 85 00000100:00100000:3.0:1788830617.994005:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 86 00000100:00100000:3.0:1788830617.994011:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25658df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+5:2355:x1875724578399872:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:3.0:1788830617.994032:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25658df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+5:2355:x1875724578399872:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 21us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830617.994038:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 86 00000100:00080000:3.0:1788830617.994053:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788830617.994586:0:8202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578400000 00000100:00100000:2.0:1788830617.994592:0:8202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578400000 00000100:00100000:2.0:1788830617.994660:0:8202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 137 00000100:00100000:2.0:1788830617.994669:0:8202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2565cc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2154ea6-69cb-4a30-aac0-000fba13e98b+5:2355:x1875724578400000:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:2.0:1788830617.994754:0:8202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2565cc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2154ea6-69cb-4a30-aac0-000fba13e98b+5:2355:x1875724578400000:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 85us (1391us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830617.994761:0:8202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 137 00000100:00080000:3.0:1788830617.995018:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788830618.002214:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830618.002384:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578400128 00000100:00100000:3.0:1788830618.002399:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578400128 00000100:00100000:3.0:1788830618.002502:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 167 00000100:00100000:3.0:1788830618.002516:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25658dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+28:11501:x1875724578400128:12345-192.168.201.21@tcp:101:lfs.0 00010000:00010000:3.0:1788830618.002547:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788830618.002574:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945200/0x575506951eea1695 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa578910534661f3d expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830618.002682:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944000/0x575506951eea169c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830618.002700:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944000/0x575506951eea169c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830618.002764:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944000/0x575506951eea169c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788830618.002812:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:3.0:1788830618.002834:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788830618.002858:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944000/0x575506951eea169c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830618.002887:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945200/0x575506951eea1695 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661f3d expref: 30 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830618.002909:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944000/0x575506951eea169c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661f3d expref: 29 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830618.002919:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e25530b0b00) 00010000:00010000:3.0:1788830618.002922:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788830618.002926:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e257d944000, rc 0) 00000100:00100000:3.0:1788830618.003000:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25658dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+29:11501:x1875724578400128:12345-192.168.201.21@tcp:101:lfs.0 Request processed in 486us (801us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830618.003008:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 167 00000100:00080000:0.0:1788830618.003265:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788830618.026871:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830618.030141:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578400512 00000100:00100000:1.0:1788830618.030164:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578400512 00000100:00100000:1.0:1788830618.030273:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 47 00000100:00100000:1.0:1788830618.030287:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25658c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+29:11501:x1875724578400512:12345-192.168.201.21@tcp:35:lfs.0 00000100:00100000:1.0:1788830618.031289:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25658c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+30:11501:x1875724578400512:12345-192.168.201.21@tcp:35:lfs.0 Request processed in 996us (4425us total) trans 4294967454 rc 0/0 00000100:00100000:1.0:1788830618.031302:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 47 00000100:00100000:1.0:1788830618.036471:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830618.036577:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578400640 00000100:00100000:0.0:1788830618.036591:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578400640 00000100:00100000:0.0:1788830618.036682:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 14 00000100:00100000:0.0:1788830618.036695:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255da68850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+30:11501:x1875724578400640:12345-192.168.201.21@tcp:103:lfs.0 00010000:00010000:0.0:1788830618.036752:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788830618.036787:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945400/0x575506951eea162c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661f21 expref: 30 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830618.036844:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729400/0x575506951eea1687 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661f36 expref: 29 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830618.036859:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728a00/0x575506951eea1530 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661ee2 expref: 28 pid: 8202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830618.036870:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e2551f3e400) 00010000:00010000:0.0:1788830618.036883:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788830618.036960:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255da68850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+27:11501:x1875724578400640:12345-192.168.201.21@tcp:103:lfs.0 Request processed in 267us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830618.036969:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 14 00000100:00100000:2.0:1788830618.043431:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830618.043548:0:8202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578400768 00000100:00100000:1.0:1788830618.043563:0:8202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578400768 00000100:00100000:1.0:1788830618.043653:0:8202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 168 00000100:00100000:1.0:1788830618.043666:0:8202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25658c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+27:11501:x1875724578400768:12345-192.168.201.21@tcp:58:lfs.0 00010000:00010000:1.0:1788830618.043899:0:8202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8d000/0x575506951eea16a3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830618.043921:0:8202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8d000/0x575506951eea16a3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830618.043935:0:8202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8d000/0x575506951eea16a3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788830618.044353:0:8202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:1.0:1788830618.044461:0:8202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25658c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+27:11501:x1875724578400768:12345-192.168.201.21@tcp:58:lfs.0 Request processed in 795us (1044us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830618.044469:0:8202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 168 00000100:00100000:2.0:1788830618.071618:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830618.071792:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578400896 00000100:00100000:3.0:1788830618.071807:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578400896 00000100:00100000:3.0:1788830618.071891:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 169 00000100:00100000:3.0:1788830618.071903:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25658c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+27:11503:x1875724578400896:12345-192.168.201.21@tcp:101:lfs.0 00010000:00010000:3.0:1788830618.071930:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788830618.071957:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945200/0x575506951eea16aa lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa578910534661f44 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830618.072050:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945400/0x575506951eea16b1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830618.072070:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945400/0x575506951eea16b1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830618.072099:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945400/0x575506951eea16b1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830618.072117:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944800/0x575506951eea16b8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830618.072124:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944800/0x575506951eea16b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830618.072131:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944800/0x575506951eea16b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830618.072481:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944200/0x575506951eea16bf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830618.072491:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944200/0x575506951eea16bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830618.072499:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944200/0x575506951eea16bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788830618.072544:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1788830618.072550:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788830618.072572:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944200/0x575506951eea16bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830618.072586:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944200/0x575506951eea16bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830618.072596:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945400/0x575506951eea16b1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830618.072614:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945400/0x575506951eea16b1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830618.072620:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945400/0x575506951eea16b1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830618.072626:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e257d945400 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:3.0:1788830618.072631:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945400/0x575506951eea16b1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830618.072639:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945400/0x575506951eea16b1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830618.072654:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e25530b0b00) 00010000:00010000:3.0:1788830618.072658:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788830618.072663:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945400/0x575506951eea16b1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830618.072669:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945400/0x575506951eea16b1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830618.072685:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944800/0x575506951eea16b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830618.072691:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944800/0x575506951eea16b8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830618.072697:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944800/0x575506951eea16b8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830618.072702:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e257d944800 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:3.0:1788830618.072790:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944800/0x575506951eea16b8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830618.072797:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944800/0x575506951eea16b8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830618.072805:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9e25530b0f00) 00010000:00010000:3.0:1788830618.072808:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788830618.072811:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944800/0x575506951eea16b8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830618.072817:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944800/0x575506951eea16b8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830618.072855:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945200/0x575506951eea16aa lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661f44 expref: 29 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830618.072870:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944200/0x575506951eea16bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661f44 expref: 28 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830618.072877:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e257480c900) 00010000:00010000:3.0:1788830618.072879:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788830618.072882:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e257d944200, rc 0) 00000100:00100000:3.0:1788830618.072968:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25658c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+28:11503:x1875724578400896:12345-192.168.201.21@tcp:101:lfs.0 Request processed in 1067us (1366us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830618.072975:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 169 00000100:00100000:3.0:1788830618.332346:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25658c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1745cc3d-3952-4cd4-9020-9b8acb483105:3309:1875724595174656:0@lo:400:kworker.0 00000100:00100000:3.0:1788830618.332457:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830618.332533:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788830618.332555:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25658c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875724595174784:0@lo:400:kworker.0 00000100:00100000:3.0:1788830618.332582:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788830618.332666:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25658c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1875724595175040:0@lo:400:kworker.0 00000100:00100000:2.0:1788830618.332690:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788830618.332745:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788830618.332756:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25658c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875724595174912:0@lo:400:kworker.0 00000100:00100000:2.0:1788830618.332786:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830618.332788:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25658c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875724595175296:0@lo:400:kworker.0 00000100:00100000:1.0:1788830618.332822:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788830618.332823:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595174784 00000100:00100000:2.0:1788830618.332833:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595174784 00000100:00100000:1.0:1788830618.332845:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788830618.332849:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25658c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1875724595175168:0@lo:400:kworker.0 00000100:00100000:1.0:1788830618.332886:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788830618.332887:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595175040 00000100:00100000:2.0:1788830618.332890:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595175040 00000100:00100000:1.0:1788830618.332913:0:8202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595175168 00000100:00100000:1.0:1788830618.332916:0:8202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595175168 00000100:00100000:2.0:1788830618.332923:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788830618.332931:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2544ee6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875724595174784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788830618.332937:0:8202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788830618.332943:0:8202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25658c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875724595175040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788830618.332983:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2544ee6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875724595174784:12345-0@lo:400:kworker.0 Request processed in 51us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830618.332983:0:8202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25658c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875724595175040:12345-0@lo:400:kworker.0 Request processed in 41us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830618.332990:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1788830618.333114:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595174656 00000100:00100000:0.0:1788830618.333120:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595174656 00000100:00100000:0.0:1788830618.333154:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:0.0:1788830618.333161:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255d94b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1745cc3d-3952-4cd4-9020-9b8acb483105+19:3309:x1875724595174656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788830618.333170:0:8202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788830618.333186:0:8202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788830618.333192:0:8202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25747c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875724595175168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788830618.333198:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255d94b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1745cc3d-3952-4cd4-9020-9b8acb483105+19:3309:x1875724595174656:12345-0@lo:400:kworker.0 Request processed in 39us (743us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830618.333204:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:1.0:1788830618.333236:0:8202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25747c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875724595175168:12345-0@lo:400:kworker.0 Request processed in 44us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830618.333243:0:8202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788830618.333276:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595174912 00000100:00100000:2.0:1788830618.333277:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595175296 00000100:00100000:2.0:1788830618.333280:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595175296 00000100:00100000:1.0:1788830618.333280:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595174912 00000100:00100000:1.0:1788830618.333462:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788830618.333471:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25658c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875724595174912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788830618.333500:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788830618.333506:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25658c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875724595174912:12345-0@lo:400:kworker.0 Request processed in 38us (720us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830618.333507:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25747c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3310:x1875724595175296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788830618.333513:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788830618.333562:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25658c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1875724595175168:0@lo:400:kworker.0 00000100:00100000:2.0:1788830618.333621:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25747c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3310:x1875724595175296:12345-0@lo:400:kworker.0 Request processed in 113us (797us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830618.333628:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788830618.333641:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25658c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875724595175296:0@lo:400:kworker.0 00000100:00080000:2.0:1788830618.333655:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788830618.333659:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788830618.333678:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25658c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875724595174912:0@lo:400:kworker.0 00000100:00100000:2.0:1788830618.333689:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25658c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1875724595175040:0@lo:400:kworker.0 00000100:00100000:2.0:1788830618.333877:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25658c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875724595174784:0@lo:400:kworker.0 00000100:00100000:2.0:1788830618.333903:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25658c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1745cc3d-3952-4cd4-9020-9b8acb483105:3309:1875724595174656:0@lo:400:kworker.0 00000040:00080000:3.0:1788830618.594919:0:11676:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788830618.594929:0:11676:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788830618.595010:0:11676:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:3.0:1788830618.595021:0:11676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788830618.595249:0:11676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2544ee6d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11676:1875724595175424:192.168.201.21@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788830618.595356:0:11676:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e257fbd6a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788830618.599344:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830618.599384:0:8202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578401024 00000100:00100000:2.0:1788830618.599395:0:8202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578401024 00000100:00100000:2.0:1788830618.599460:0:8202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 170 00000100:00100000:2.0:1788830618.599473:0:8202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25658c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+29:11515:x1875724578401024:12345-192.168.201.21@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788830618.599518:0:8202:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788830618.599672:0:8202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25658c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+29:11515:x1875724578401024:12345-192.168.201.21@tcp:53:lhsmtool_posix.0 Request processed in 203us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830618.599681:0:8202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 170 00000100:00100000:0.0:1788830618.600258:0:11676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2544ee6d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11676:1875724595175424:192.168.201.21@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788830618.609026:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830618.609526:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578401152 00000100:00100000:2.0:1788830618.609541:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578401152 00000100:00100000:2.0:1788830618.609657:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 171 00000100:00100000:2.0:1788830618.609670:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2544ee7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+28:11515:x1875724578401152:12345-192.168.201.21@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788830618.609800:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728e00/0x575506951eea16c6 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830618.609825:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728e00/0x575506951eea16c6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830618.609841:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728e00/0x575506951eea16c6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830618.609862:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728a00/0x575506951eea16cd lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830618.609870:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728a00/0x575506951eea16cd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830618.609891:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728a00/0x575506951eea16cd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830618.609927:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729400/0x575506951eea16d4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830618.609937:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729400/0x575506951eea16d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830618.609944:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729400/0x575506951eea16d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788830618.609993:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1788830618.609999:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788830618.610015:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729400/0x575506951eea16d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830618.610028:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728e00/0x575506951eea16c6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830618.610036:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728e00/0x575506951eea16c6 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830618.610044:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728e00/0x575506951eea16c6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830618.610051:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2565728e00 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:2.0:1788830618.610056:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728e00/0x575506951eea16c6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830618.610078:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728e00/0x575506951eea16c6 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830618.610101:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e257480cd00) 00010000:00010000:2.0:1788830618.610105:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788830618.610112:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728e00/0x575506951eea16c6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830618.610119:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728e00/0x575506951eea16c6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830618.610136:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728a00/0x575506951eea16cd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830618.610142:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728a00/0x575506951eea16cd lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830618.610148:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728a00/0x575506951eea16cd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830618.610154:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2565728a00 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:2.0:1788830618.610157:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728a00/0x575506951eea16cd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830618.610164:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728a00/0x575506951eea16cd lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830618.610172:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff9e2551f3ee00) 00010000:00010000:2.0:1788830618.610174:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788830618.610177:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728a00/0x575506951eea16cd lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830618.610184:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728a00/0x575506951eea16cd lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830618.610210:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729400/0x575506951eea16d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830618.610217:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729400/0x575506951eea16d4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830618.610223:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729400/0x575506951eea16d4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830618.610229:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2565729400 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:2.0:1788830618.610232:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729400/0x575506951eea16d4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830618.610238:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729400/0x575506951eea16d4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830618.610247:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e257480c900) 00010000:00010000:2.0:1788830618.610250:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788830618.610253:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729400/0x575506951eea16d4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830618.610259:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729400/0x575506951eea16d4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788830618.610361:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2544ee7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+28:11515:x1875724578401152:12345-192.168.201.21@tcp:34:lhsmtool_posix.0 Request processed in 691us (1349us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830618.610371:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 171 00000100:00100000:1.0:1788830618.614042:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830618.614197:0:8202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578401408 00000100:00100000:3.0:1788830618.614211:0:8202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578401408 00000100:00100000:3.0:1788830618.614293:0:8202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 172 00000100:00100000:3.0:1788830618.614306:0:8202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2445d01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+28:11515:x1875724578401408:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788830618.614334:0:8202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788830618.614360:0:8202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945200/0x575506951eea16db lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa578910534661f4b expref: -99 pid: 8202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830618.614495:0:8202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945400/0x575506951eea16e2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830618.614514:0:8202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945400/0x575506951eea16e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830618.614529:0:8202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945400/0x575506951eea16e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788830618.614543:0:8202:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1788830618.614671:0:8202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945400/0x575506951eea16e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830618.614693:0:8202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945400/0x575506951eea16e2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830618.614701:0:8202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945400/0x575506951eea16e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830618.614743:0:8202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e257d945400 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:3.0:1788830618.614749:0:8202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945400/0x575506951eea16e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830618.614758:0:8202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945400/0x575506951eea16e2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830618.614774:0:8202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e257480c900) 00010000:00010000:3.0:1788830618.614777:0:8202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788830618.614782:0:8202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945400/0x575506951eea16e2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830618.614789:0:8202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945400/0x575506951eea16e2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830618.614844:0:8202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945200/0x575506951eea16db lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661f4b expref: 30 pid: 8202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830618.614856:0:8202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e257480cd00) 00010000:00010000:3.0:1788830618.614858:0:8202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788830618.614862:0:8202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945200/0x575506951eea16db lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661f4b expref: 30 pid: 8202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830618.614873:0:8202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e257d945200, rc 0) 00000100:00100000:3.0:1788830618.614959:0:8202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2445d01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+29:11515:x1875724578401408:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 Request processed in 655us (934us total) trans 4294967455 rc 301/301 00000100:00100000:3.0:1788830618.614966:0:8202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 172 00000100:00100000:2.0:1788830618.619025:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830618.619163:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578401536 00000100:00100000:3.0:1788830618.619177:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578401536 00000100:00100000:3.0:1788830618.619253:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 173 00000100:00100000:3.0:1788830618.619267:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25658c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+29:11515:x1875724578401536:12345-192.168.201.21@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788830618.619316:0:5833:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788830618.619454:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25658c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+29:11515:x1875724578401536:12345-192.168.201.21@tcp:53:lhsmtool_posix.0 Request processed in 190us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830618.619463:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 173 00000100:00100000:3.0:1788830618.624313:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830618.626026:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578401792 00000100:00100000:0.0:1788830618.626053:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578401792 00000100:00100000:0.0:1788830618.626177:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 174 00000100:00100000:0.0:1788830618.626191:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2544ee4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+29:11515:x1875724578401792:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788830618.626226:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788830618.626238:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788830618.626282:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944000/0x575506951eea169c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661f3d expref: 29 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830618.626305:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e25530b0b00) 00010000:00010000:0.0:1788830618.626311:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788830618.626332:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea16f0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa578910534661f52 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788830618.627196:0:5832:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:0.0:1788830618.627475:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f000/0x575506951eea16f7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830618.627493:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f000/0x575506951eea16f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830618.627505:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f000/0x575506951eea16f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830618.627572:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea16f0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661f52 expref: 31 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830618.627587:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f000/0x575506951eea16f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661f52 expref: 30 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830618.627596:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9e25518dc200) 00010000:00010000:0.0:1788830618.627599:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788830618.627603:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2445b7f000, rc 0) 00000100:00100000:0.0:1788830618.627693:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2544ee4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+30:11515:x1875724578401792:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 Request processed in 1506us (3396us total) trans 4294967456 rc 0/0 00000100:00100000:0.0:1788830618.627749:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 174 00000100:00100000:1.0:1788830618.630853:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830618.631106:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578402048 00000100:00100000:3.0:1788830618.631120:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578402048 00000100:00100000:3.0:1788830618.631201:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 175 00000100:00100000:3.0:1788830618.631216:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2445d02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+30:11515:x1875724578402048:12345-192.168.201.21@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788830618.631299:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788830618.631336:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f000/0x575506951eea16f7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661f52 expref: 30 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830618.631356:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9e25518dc200) 00010000:00010000:3.0:1788830618.631369:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788830618.631400:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944800/0x575506951eea1705 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830618.631428:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944800/0x575506951eea1705 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830618.631453:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944800/0x575506951eea1705 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830618.631476:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945200/0x575506951eea170c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x492b314a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830618.631484:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945200/0x575506951eea170c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x492b314a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830618.631491:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945200/0x575506951eea170c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x492b314a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830618.631807:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944800/0x575506951eea1705 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830618.631817:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944800/0x575506951eea1705 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830618.631825:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944800/0x575506951eea1705 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830618.631832:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e257d944800 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:3.0:1788830618.631837:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944800/0x575506951eea1705 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830618.631846:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944800/0x575506951eea1705 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830618.631857:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e25530b0b00) 00010000:00010000:3.0:1788830618.631861:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788830618.631865:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944800/0x575506951eea1705 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830618.631879:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944800/0x575506951eea1705 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830618.631890:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945200/0x575506951eea170c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x492b314a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830618.631897:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945200/0x575506951eea170c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x492b314a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830618.631903:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945200/0x575506951eea170c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x492b314a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830618.631908:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e257d945200 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:3.0:1788830618.631911:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945200/0x575506951eea170c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x492b314a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830618.631917:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945200/0x575506951eea170c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x492b314a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830618.631925:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x492b314a (ffff9e25530b0f00) 00010000:00010000:3.0:1788830618.631929:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788830618.631931:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945200/0x575506951eea170c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x492b314a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830618.631937:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945200/0x575506951eea170c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x492b314a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788830618.632054:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2445d02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+29:11515:x1875724578402048:12345-192.168.201.21@tcp:36:lhsmtool_posix.0 Request processed in 840us (1215us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788830618.632062:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 175 00000100:00100000:3.0:1788830618.636159:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830618.636399:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578402176 00000100:00100000:0.0:1788830618.636413:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578402176 00000100:00100000:0.0:1788830618.636496:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 176 00000100:00100000:0.0:1788830618.636509:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2544ee5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+29:11515:x1875724578402176:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788830618.636535:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788830618.636564:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea1713 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa578910534661f59 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830618.636606:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e200/0x575506951eea171a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830618.636622:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e200/0x575506951eea171a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830618.636635:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e200/0x575506951eea171a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830618.636788:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea1713 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661f59 expref: 31 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830618.636810:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e200/0x575506951eea171a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661f59 expref: 30 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830618.636820:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9e25518dc900) 00010000:00010000:0.0:1788830618.636823:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788830618.636827:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2445b7e200, rc 0) 00000100:00100000:0.0:1788830618.636909:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2544ee5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+30:11515:x1875724578402176:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 Request processed in 403us (769us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830618.636924:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 176 00000100:00100000:0.0:1788830618.639971:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830618.642845:0:8202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578402432 00000100:00100000:2.0:1788830618.642868:0:8202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578402432 00000100:00100000:2.0:1788830618.642960:0:8202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 177 00000100:00100000:2.0:1788830618.642974:0:8202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257fac8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+30:11515:x1875724578402432:12345-192.168.201.21@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788830618.643362:0:8202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729400/0x575506951eea1721 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830618.643385:0:8202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729400/0x575506951eea1721 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830618.643401:0:8202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729400/0x575506951eea1721 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788830618.643974:0:8202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:2.0:1788830618.643989:0:8202:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 371991278594ns, next at 372991275541ns, rc = 0 00000004:00010000:2.0:1788830618.644186:0:8202:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002687a47c reply state 00000000b09d92a6 transno 4294967457 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729400/0x575506951eea1721 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788830618.644198:0:8202:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788830618.644810:0:8202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257fac8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+32:11515:x1875724578402432:12345-192.168.201.21@tcp:36:lhsmtool_posix.0 Request processed in 1833us (4846us total) trans 4294967457 rc 0/0 00000100:00100000:2.0:1788830618.644820:0:8202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 177 00010000:00010000:0.0:1788830618.650470:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729400/0x575506951eea1721 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830618.650497:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729400/0x575506951eea1721 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830618.650506:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729400/0x575506951eea1721 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830618.650514:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2565729400 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:0.0:1788830618.650520:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729400/0x575506951eea1721 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830618.650529:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729400/0x575506951eea1721 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830618.650552:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9e25518dc900) 00010000:00010000:0.0:1788830618.650556:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788830618.650563:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729400/0x575506951eea1721 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830618.650570:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729400/0x575506951eea1721 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788830618.654142:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830618.654192:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578402560 00000100:00100000:3.0:1788830618.654205:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578402560 00000100:00100000:3.0:1788830618.654275:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 178 00000100:00100000:3.0:1788830618.654289:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2544ee5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+31:11515:x1875724578402560:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788830618.654321:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788830618.654349:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945400/0x575506951eea1728 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa578910534661f60 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830618.654438:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945400/0x575506951eea1728 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661f60 expref: 32 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830618.654457:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945400/0x575506951eea1728 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661f60 expref: 32 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830618.654481:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9e25518dc900) 00010000:00010000:3.0:1788830618.654485:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788830618.654490:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e257d945400, rc 0) 00000100:00100000:3.0:1788830618.654557:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2544ee5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+32:11515:x1875724578402560:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 Request processed in 272us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830618.654564:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 178 00010000:00010000:1.0:1788830618.657033:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788830618.661066:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830618.661173:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578402688 00000100:00100000:0.0:1788830618.661187:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578402688 00000100:00100000:0.0:1788830618.661275:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 53 00000100:00100000:0.0:1788830618.661288:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2544ee7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+6:2354:x1875724578402688:12345-192.168.201.21@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1788830618.662057:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2544ee7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+7:2354:x1875724578402688:12345-192.168.201.21@tcp:2:lhsmtool_posix.0 Request processed in 768us (1003us total) trans 4294967313 rc 0/0 00000100:00100000:0.0:1788830618.662067:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 53 00000100:00100000:0.0:1788830618.665384:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830618.665461:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578402944 00000100:00100000:1.0:1788830618.665475:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578402944 00000100:00100000:1.0:1788830618.665550:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 48 00000100:00100000:1.0:1788830618.665562:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257fac9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+32:11515:x1875724578402944:12345-192.168.201.21@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788830618.665978:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257fac9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+33:11515:x1875724578402944:12345-192.168.201.21@tcp:35:lhsmtool_posix.0 Request processed in 417us (608us total) trans 4294967458 rc 0/0 00000100:00100000:1.0:1788830618.665988:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 48 00000100:00100000:2.0:1788830618.672044:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830618.672300:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578403200 00000100:00100000:3.0:1788830618.672313:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578403200 00000100:00100000:3.0:1788830618.672388:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 179 00000100:00100000:3.0:1788830618.672400:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25658c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+33:11515:x1875724578403200:12345-192.168.201.21@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788830618.672574:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25658c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+33:11515:x1875724578403200:12345-192.168.201.21@tcp:57:lhsmtool_posix.0 Request processed in 175us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830618.672584:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 179 00000100:00100000:1.0:1788830618.675114:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830618.675262:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578403328 00000100:00100000:3.0:1788830618.675275:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578403328 00000100:00100000:3.0:1788830618.675339:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 180 00000100:00100000:3.0:1788830618.675351:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2445d00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+33:11515:x1875724578403328:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788830618.675376:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788830618.675402:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945200/0x575506951eea172f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa578910534661f67 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830618.675492:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944800/0x575506951eea1736 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830618.675510:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944800/0x575506951eea1736 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830618.675526:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944800/0x575506951eea1736 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788830618.675572:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788830618.675597:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944800/0x575506951eea1736 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830618.675630:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945200/0x575506951eea172f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661f67 expref: 35 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830618.675652:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944800/0x575506951eea1736 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661f67 expref: 34 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830618.675677:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9e25518dc900) 00010000:00010000:3.0:1788830618.675680:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788830618.675684:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e257d944800, rc 0) 00000100:00100000:3.0:1788830618.675873:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2445d00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+34:11515:x1875724578403328:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 Request processed in 523us (771us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830618.675882:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 180 00000100:00100000:1.0:1788830618.679089:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830618.679230:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578403456 00000100:00100000:0.0:1788830618.679245:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578403456 00000100:00100000:0.0:1788830618.679324:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 54 00000100:00100000:0.0:1788830618.679338:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2445d01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+7:2355:x1875724578403456:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788830618.679363:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788830618.679393:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000347152c2/0x575506951eea173d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa578910534661f6e expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788830618.679429:0:6680:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9f639a, blocks: 0x1 00010000:00010000:0.0:1788830618.679456:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=372s v=(0 0) 00010000:00010000:0.0:1788830618.679462:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788830618.679476:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000347152c2/0x575506951eea173d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661f6e expref: 8 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830618.679501:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000347152c2/0x575506951eea173d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661f6e expref: 8 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830618.679518:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2445b7ee00, rc 0) 00000100:00100000:0.0:1788830618.679599:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2445d01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+8:2355:x1875724578403456:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 Request processed in 263us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830618.679607:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 54 00000100:00100000:2.0:1788830618.687014:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830618.687142:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578403712 00000100:00100000:3.0:1788830618.687155:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578403712 00000100:00100000:3.0:1788830618.687224:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 181 00000100:00100000:3.0:1788830618.687236:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25658c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+34:11515:x1875724578403712:12345-192.168.201.21@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788830618.688907:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25658c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+34:11515:x1875724578403712:12345-192.168.201.21@tcp:57:lhsmtool_posix.0 Request processed in 1659us (1893us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830618.688921:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 181 00000100:00100000:1.0:1788830618.694125:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830618.699202:0:12010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578403840 00000100:00100000:3.0:1788830618.699226:0:12010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578403840 00000100:00100000:3.0:1788830618.699309:0:12010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 55 00000100:00100000:3.0:1788830618.699323:0:12010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2445d03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+8:11515:x1875724578403840:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788830618.699347:0:12010:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788830618.699372:0:12010:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000037589048/0x575506951eea1744 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa578910534661f75 expref: -99 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830618.699416:0:12010:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000347152c2/0x575506951eea173d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661f6e expref: 9 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830618.699440:0:12010:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788830618.699446:0:12010:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788830618.699452:0:12010:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000037589048/0x575506951eea1744 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661f75 expref: 9 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830618.699502:0:12010:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000347152c2/0x575506951eea173d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.21@tcp remote: 0xa578910534661f6e expref: 9 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830618.699519:0:12010:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000347152c2/0x575506951eea173d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661f6e expref: 9 pid: 6680 timeout: 472 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788830618.699535:0:12010:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2544ee4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:12010:1875724595175552:192.168.201.21@tcp:104: 00000100:00100000:3.0:1788830618.699674:0:12010:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e257fbd6600 going to sleep for 11 seconds 00000100:00100000:1.0:1788830618.704410:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830618.704457:0:11161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578403968 00000100:00100000:1.0:1788830618.704467:0:11161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578403968 00010000:00010000:1.0:1788830618.704517:0:11161:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000347152c2/0x575506951eea173d lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661f6e expref: 10 pid: 6680 timeout: 472 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788830618.704567:0:11161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 69 00000100:00100000:1.0:1788830618.704578:0:11161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2445d00a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+10:2354:x1875724578403968:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788830618.704598:0:11161:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788830618.704631:0:11161:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000347152c2/0x575506951eea173d lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661f6e expref: 10 pid: 6680 timeout: 472 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830618.704649:0:11161:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000347152c2/0x575506951eea173d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661f6e expref: 10 pid: 6680 timeout: 472 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830618.704683:0:11161:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788830618.704688:0:11161:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788830618.704698:0:11161:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000037589048/0x575506951eea1744 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661f75 expref: 10 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830618.704738:0:11161:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000037589048/0x575506951eea1744 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661f75 expref: 10 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830618.706043:0:12010:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000347152c2/0x575506951eea173d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661f6e expref: 10 pid: 6680 timeout: 472 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788830618.706143:0:12010:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2544ee4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:12010:1875724595175552:192.168.201.21@tcp:104: 00010000:00010000:3.0:1788830618.706183:0:12010:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000037589048/0x575506951eea1744 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.21@tcp remote: 0xa578910534661f75 expref: 9 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830618.706200:0:12010:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e257d945200, rc 0) 00000100:00100000:3.0:1788830618.706300:0:12010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2445d03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+9:11515:x1875724578403840:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 Request processed in 6980us (12254us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830618.706323:0:12010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 55 00010000:00010000:1.0:1788830618.707164:0:11161:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000037589048/0x575506951eea1744 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.21@tcp remote: 0xa578910534661f75 expref: 8 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788830618.707195:0:11161:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2445d02a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:11161:1875724595175680:192.168.201.21@tcp:105: 00000100:00100000:1.0:1788830618.707313:0:11161:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2548317780 going to sleep for 11 seconds 00000100:00100000:1.0:1788830618.717068:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830618.717115:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578404096 00000100:00100000:1.0:1788830618.717127:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578404096 00002000:00100000:1.0:1788830618.717194:0:6684:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9e2445d02d80 x1875724578404096/t0(0) o4->1ef2fe7a-e5ec-4085-8326-b72aa00876cd@192.168.201.21@tcp:69/0 lens 504/0 e 0 to 0 dl 1788830629 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788830618.717208:0:6684:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e2445d02d80 with x1875724578404096 ext(0->8) 00002000:00010000:1.0:1788830618.717215:0:6684:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e2445d02d80 00000100:00100000:1.0:1788830618.717249:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 4 00000100:00100000:1.0:1788830618.717261:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2445d02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+9:2354:x1875724578404096:12345-192.168.201.21@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788830618.717956:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2445d02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+11:2354:x1875724578404096:12345-192.168.201.21@tcp:4:lhsmtool_posix.0 Request processed in 695us (911us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1788830618.717966:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 4 00002000:00100000:1.0:1788830618.717975:0:6684:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9e2445d02d80 x1875724578404096/t4294967314(0) o4->1ef2fe7a-e5ec-4085-8326-b72aa00876cd@192.168.201.21@tcp:69/0 lens 504/448 e 0 to 0 dl 1788830629 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788830618.717984:0:6684:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e2445d02d80 with x1875724578404096 ext(0->8) 00002000:00010000:1.0:1788830618.717988:0:6684:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e2445d02d80 00000100:00100000:1.0:1788830618.718408:0:11161:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2445d02a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:11161:1875724595175680:192.168.201.21@tcp:105: 00010000:00010000:1.0:1788830618.718437:0:11161:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788830618.718473:0:11161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2445d00a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+10:2354:x1875724578403968:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 13897us (14078us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830618.718483:0:11161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 69 00000100:00100000:1.0:1788830618.724942:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830618.725098:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578404224 00000100:00100000:0.0:1788830618.725112:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578404224 00000100:00100000:0.0:1788830618.725197:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 182 00000100:00100000:0.0:1788830618.725209:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2445d02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+34:11515:x1875724578404224:12345-192.168.201.21@tcp:44:lhsmtool_posix.0 00000040:00080000:0.0:1788830618.744282:0:12505:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788830618.744293:0:12505:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788830618.744348:0:12505:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:0.0:1788830618.744355:0:12505:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:2.0:1788830618.777489:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967456 is committed 00000001:00080000:2.0:1788830618.777515:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967458 is committed 00000004:00080000:2.0:1788830618.777538:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000020:00080000:2.0:1788830618.777564:0:5855:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000020:00080000:2.0:1788830618.777839:0:5866:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:2.0:1788830618.777852:0:5866:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:2.0:1788830618.777874:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25658c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875724595175808:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788830618.777979:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830618.786172:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2445d02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+18:11515:x1875724578404224:12345-192.168.201.21@tcp:44:lhsmtool_posix.0 Request processed in 60946us (61226us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830618.786191:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 182 00000100:00100000:0.0:1788830618.786251:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595175808 00000100:00100000:0.0:1788830618.786264:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595175808 00000100:00100000:0.0:1788830618.786331:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788830618.786343:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25658c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875724595175808:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1788830618.786587:0:6680:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1788830618.786591:0:6680:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788830618 00002000:00010000:0.0:1788830618.786593:0:6680:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788830618.786595:0:6680:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1788830618 -> 1788830618 00002000:00010000:0.0:1788830618.786598:0:6680:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1788830618.786924:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25658c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3307:x1875724595175808:12345-0@lo:2:osp-syn-0-0.0 Request processed in 582us (8945us total) trans 4294967315 rc 0/0 00000100:00100000:0.0:1788830618.786932:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000004:00080000:2.0:1788830618.786975:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e25658c3b80/2, rc 0, transno 4294967315 00000100:00100000:2.0:1788830618.786985:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25658c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875724595175808:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788830618.793705:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830618.793891:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578404352 00000100:00100000:3.0:1788830618.793905:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578404352 00000100:00100000:3.0:1788830618.793987:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 57 00000100:00100000:3.0:1788830618.794001:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25658c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+10:2355:x1875724578404352:12345-192.168.201.21@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1788830618.840794:0:6709:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000001:00080000:2.0:1788830618.840814:0:6709:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967313 is committed 00000001:00080000:2.0:1788830618.840821:0:6709:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967314 is committed 00000100:00100000:1.0:1788830618.841009:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25658c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+7:2355:x1875724578404352:12345-192.168.201.21@tcp:16:lhsmtool_posix.0 Request processed in 47006us (47314us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830618.841032:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 57 00000100:00100000:2.0:1788830618.844125:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788830618.844163:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25658c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875724595175936:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788830618.844288:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788830618.844392:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595175936 00000100:00100000:2.0:1788830618.844415:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595175936 00000100:00100000:2.0:1788830618.844489:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788830618.844500:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2445d43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1875724595175936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788830618.844549:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788830618.844621:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2445d43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1875724595175936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 121us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830618.844630:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788830618.844705:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25658c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875724595175936:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788830618.851852:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830618.852298:0:8202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578404608 00000100:00100000:2.0:1788830618.852312:0:8202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578404608 00000100:00100000:2.0:1788830618.852387:0:8202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 183 00000100:00100000:2.0:1788830618.852410:0:8202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2544ee4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+18:11515:x1875724578404608:12345-192.168.201.21@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788830618.852485:0:8202:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788830618.852521:0:8202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944800/0x575506951eea1736 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661f67 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830618.852572:0:8202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9e25518dc900) 00010000:00010000:2.0:1788830618.852579:0:8202:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788830618.852633:0:8202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729000/0x575506951eea174b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830618.852646:0:8202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729000/0x575506951eea174b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830618.852655:0:8202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729000/0x575506951eea174b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788830618.853036:0:8202:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000089a948ca reply state 0000000000f99508 transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729000/0x575506951eea174b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788830618.853048:0:8202:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788830618.853187:0:8202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2544ee4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+19:11515:x1875724578404608:12345-192.168.201.21@tcp:36:lhsmtool_posix.0 Request processed in 789us (1349us total) trans 4294967459 rc 0/0 00000100:00100000:2.0:1788830618.853195:0:8202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 183 00010000:00010000:0.0:1788830618.856613:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729000/0x575506951eea174b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830618.856632:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729000/0x575506951eea174b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830618.856647:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729000/0x575506951eea174b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830618.856652:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2565729000 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:0.0:1788830618.856656:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729000/0x575506951eea174b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830618.856662:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729000/0x575506951eea174b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830618.856681:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9e25518dc900) 00010000:00010000:0.0:1788830618.856684:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788830618.856687:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729000/0x575506951eea174b lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830618.856692:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729000/0x575506951eea174b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788830618.857358:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830618.857576:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578404736 00000100:00100000:0.0:1788830618.857594:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578404736 00000100:00100000:0.0:1788830618.860049:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 58 00000100:00100000:0.0:1788830618.860070:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2544ee6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+7:2355:x1875724578404736:12345-192.168.201.21@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788830618.860405:0:6679:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1788830618.860409:0:6679:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1788830618 -> 1788830617 00002000:00010000:0.0:1788830618.860413:0:6679:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788830615 00002000:00010000:0.0:1788830618.860415:0:6679:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1788830618 -> 1788830617 00002000:00010000:0.0:1788830618.860417:0:6679:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1788830618.860537:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2544ee6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+8:2355:x1875724578404736:12345-192.168.201.21@tcp:2:lhsmtool_posix.0 Request processed in 472us (3186us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1788830618.860555:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 58 00000100:00100000:2.0:1788830618.868230:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830618.868331:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578404992 00000100:00100000:3.0:1788830618.868345:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578404992 00000100:00100000:3.0:1788830618.868451:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 184 00000100:00100000:3.0:1788830618.868465:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2445d40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+18:11515:x1875724578404992:12345-192.168.201.21@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788830618.868584:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945c00/0x575506951eea1752 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830618.868618:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e200/0x575506951eea171a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661f59 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830618.868628:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945c00/0x575506951eea1752 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830618.868676:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e200/0x575506951eea171a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.21@tcp remote: 0xa578910534661f59 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830618.868693:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e200/0x575506951eea171a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661f59 expref: 18 pid: 5832 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788830618.868745:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2544ee4000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5834:1875724595176064:192.168.201.21@tcp:104: 00000100:00100000:3.0:1788830618.868879:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e257fbd6a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788830618.871020:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2544ee4000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5834:1875724595176064:192.168.201.21@tcp:104: 00010000:00010000:2.0:1788830618.871123:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945c00/0x575506951eea1752 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788830618.874475:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830618.874586:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578405120 00000100:00100000:0.0:1788830618.874601:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578405120 00010000:00010000:0.0:1788830618.874655:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e200/0x575506951eea171a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661f59 expref: 19 pid: 5832 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788830618.874762:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 70 00000100:00100000:0.0:1788830618.874776:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2445d42300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+19:2355:x1875724578405120:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788830618.874795:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788830618.874804:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e200/0x575506951eea171a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661f59 expref: 19 pid: 5832 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830618.874819:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e200/0x575506951eea171a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661f59 expref: 19 pid: 5832 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830618.874849:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e200/0x575506951eea171a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661f59 expref: 19 pid: 5832 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830618.874865:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9e25518dc900) 00010000:00010000:0.0:1788830618.874871:0:5819:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945c00/0x575506951eea1752 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830618.874883:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945c00/0x575506951eea1752 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830618.874891:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945c00/0x575506951eea1752 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830618.874927:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788830618.874947:0:5834:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945c00/0x575506951eea1752 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830618.874955:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945c00/0x575506951eea1752 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830618.874999:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945c00/0x575506951eea1752 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830618.875007:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945c00/0x575506951eea1752 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830618.875014:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945c00/0x575506951eea1752 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830618.875021:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e257d945c00 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:2.0:1788830618.875026:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945c00/0x575506951eea1752 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830618.875034:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945c00/0x575506951eea1752 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830618.875043:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9e25518dc900) 00010000:00010000:2.0:1788830618.875047:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1788830618.875050:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945c00/0x575506951eea1752 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830618.875067:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945c00/0x575506951eea1752 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788830618.875230:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2445d40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+18:11515:x1875724578404992:12345-192.168.201.21@tcp:55:lhsmtool_posix.0 Request processed in 6767us (7018us total) trans 0 rc -22/-22 00000100:00100000:2.0:1788830618.875240:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 184 00000100:00100000:0.0:1788830618.875273:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2445d42300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+17:2355:x1875724578405120:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 500us (815us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830618.875281:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 70 00000100:00100000:3.0:1788830618.877113:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830618.877254:0:12010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578405248 00000100:00100000:2.0:1788830618.877266:0:12010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578405248 00000100:00100000:2.0:1788830618.877373:0:12010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 59 00000100:00100000:2.0:1788830618.877391:0:12010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2544ee7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+8:2355:x1875724578405248:12345-192.168.201.21@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788830618.877457:0:12010:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c7dc25c5/0x575506951eea1759 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830618.877484:0:12010:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000037589048/0x575506951eea1744 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.21@tcp remote: 0xa578910534661f75 expref: 8 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830618.877494:0:12010:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788830618.877499:0:12010:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788830618.877504:0:12010:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c7dc25c5/0x575506951eea1759 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830618.877547:0:12010:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000037589048/0x575506951eea1744 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.21@tcp remote: 0xa578910534661f75 expref: 8 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830618.877565:0:12010:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000037589048/0x575506951eea1744 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.21@tcp remote: 0xa578910534661f75 expref: 8 pid: 12010 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788830618.877582:0:12010:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2445d40000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:12010:1875724595176192:192.168.201.21@tcp:104: 00000100:00100000:2.0:1788830618.877685:0:12010:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e25656196c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788830618.880263:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830618.880282:0:12010:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2445d40000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:12010:1875724595176192:192.168.201.21@tcp:104: 00010000:00010000:0.0:1788830618.880319:0:12010:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c7dc25c5/0x575506951eea1759 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788830618.880394:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578405376 00000100:00100000:1.0:1788830618.880403:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578405376 00010000:00010000:1.0:1788830618.880451:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000037589048/0x575506951eea1744 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.21@tcp remote: 0xa578910534661f75 expref: 9 pid: 12010 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788830618.880599:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 71 00000100:00100000:1.0:1788830618.880612:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2544ee5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+9:2355:x1875724578405376:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788830618.880633:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788830618.880664:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000037589048/0x575506951eea1744 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.21@tcp remote: 0xa578910534661f75 expref: 9 pid: 12010 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830618.880681:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000037589048/0x575506951eea1744 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.21@tcp remote: 0xa578910534661f75 expref: 9 pid: 12010 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830618.880743:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000037589048/0x575506951eea1744 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.21@tcp remote: 0xa578910534661f75 expref: 9 pid: 12010 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830618.880764:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788830618.880769:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788830618.880775:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c7dc25c5/0x575506951eea1759 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830618.880785:0:5818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c7dc25c5/0x575506951eea1759 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830618.880840:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788830618.880904:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2544ee5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+8:2355:x1875724578405376:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 294us (657us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830618.880912:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 71 00010000:00010000:3.0:1788830618.880980:0:12010:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c7dc25c5/0x575506951eea1759 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830618.880990:0:12010:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c7dc25c5/0x575506951eea1759 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830618.881022:0:12010:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c7dc25c5/0x575506951eea1759 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830618.881033:0:12010:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c7dc25c5/0x575506951eea1759 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830618.881042:0:12010:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c7dc25c5/0x575506951eea1759 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830618.881051:0:12010:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2565729800 already unused, calling callback (ffffffffc14cb350) 00010000:00010000:3.0:1788830618.881066:0:12010:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7dc25c5/0x575506951eea1759 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830618.881076:0:12010:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7dc25c5/0x575506951eea1759 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830618.881092:0:12010:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c7dc25c5/0x575506951eea1759 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830618.881109:0:12010:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c7dc25c5/0x575506951eea1759 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788830618.881170:0:12010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2544ee7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+7:2355:x1875724578405248:12345-192.168.201.21@tcp:1:lhsmtool_posix.0 Request processed in 3782us (4067us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830618.881180:0:12010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 59 00000100:00100000:2.0:1788830618.883291:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830618.884045:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578405632 00000100:00100000:1.0:1788830618.884061:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578405632 00000100:00100000:1.0:1788830618.884136:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 185 00000100:00100000:1.0:1788830618.884146:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2445d43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+17:11515:x1875724578405632:12345-192.168.201.21@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788830618.884242:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8c400/0x575506951eea1760 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830618.884262:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8c400/0x575506951eea1760 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830618.884277:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8c400/0x575506951eea1760 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830618.884548:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8da00/0x575506951eea1767 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830618.884558:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945400/0x575506951eea1728 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661f60 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830618.884565:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8da00/0x575506951eea1767 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830618.884600:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945400/0x575506951eea1728 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.21@tcp remote: 0xa578910534661f60 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830618.884625:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945400/0x575506951eea1728 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661f60 expref: 18 pid: 5832 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788830618.884638:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2445d03800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5833:1875724595176320:192.168.201.21@tcp:104: 00000100:00100000:1.0:1788830618.885659:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2548317600 going to sleep for 11 seconds 00000100:00100000:0.0:1788830618.887848:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2445d03800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5833:1875724595176320:192.168.201.21@tcp:104: 00010000:00010000:0.0:1788830618.887889:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8da00/0x575506951eea1767 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788830618.888029:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830618.888096:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578405760 00000100:00100000:3.0:1788830618.888107:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578405760 00010000:00010000:3.0:1788830618.888154:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945400/0x575506951eea1728 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661f60 expref: 19 pid: 5832 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788830618.888292:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 72 00000100:00100000:3.0:1788830618.888304:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2445d41c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+19:2355:x1875724578405760:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788830618.888322:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788830618.888330:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945400/0x575506951eea1728 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661f60 expref: 19 pid: 5832 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830618.888345:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945400/0x575506951eea1728 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661f60 expref: 19 pid: 5832 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830618.888372:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945400/0x575506951eea1728 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661f60 expref: 19 pid: 5832 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830618.888388:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9e25518dc900) 00010000:00010000:3.0:1788830618.888395:0:5817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8da00/0x575506951eea1767 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830618.888411:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8da00/0x575506951eea1767 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830618.888419:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8da00/0x575506951eea1767 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830618.888451:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788830618.888503:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8da00/0x575506951eea1767 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788830618.888519:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2445d41c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+18:2355:x1875724578405760:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 213us (497us total) trans 0 rc 0/0 00010000:00010000:2.0:1788830618.888520:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8da00/0x575506951eea1767 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788830618.888536:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 72 00000001:00080000:2.0:1788830618.888793:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967460 00000001:00080000:2.0:1788830618.888981:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967461 00000001:00080000:2.0:1788830618.889027:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000100:00100000:2.0:1788830618.889124:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2445d41500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5833:1875724595176448:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788830618.889187:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788830618.889239:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2565619480 going to sleep for 11 seconds 00000100:00100000:3.0:1788830618.889284:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595176448 00000100:00100000:3.0:1788830618.889292:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595176448 00000100:00100000:3.0:1788830618.889383:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788830618.889393:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2445d42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5833:x1875724595176448:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788830618.889502:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2445d42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5833:x1875724595176448:12345-0@lo:1000:mdt00_001.0 Request processed in 110us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830618.889509:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788830618.889994:0:5833:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:2.0:1788830618.890002:0:5833:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e25658c3b80, transno 4294967315 00000100:00100000:2.0:1788830618.890021:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2445d41500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5833:1875724595176448:0@lo:1000:mdt00_001.0 00000001:00080000:2.0:1788830618.890872:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000100:00100000:2.0:1788830618.890939:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2445d41500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5833:1875724595176576:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788830618.890986:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788830618.891013:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2565619a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788830618.891111:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595176576 00000100:00100000:0.0:1788830618.891123:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595176576 00000100:00100000:0.0:1788830618.891184:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788830618.891196:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2445d40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5833:x1875724595176576:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788830618.891453:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2445d40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5833:x1875724595176576:12345-0@lo:1000:mdt00_001.0 Request processed in 259us (466us total) trans 4294967317 rc 0/0 00000100:00100000:0.0:1788830618.891463:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788830618.891563:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2445d41500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5833:1875724595176576:0@lo:1000:mdt00_001.0 00010000:00010000:2.0:1788830618.891598:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8da00/0x575506951eea1767 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830618.891608:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8da00/0x575506951eea1767 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830618.891615:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8da00/0x575506951eea1767 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830618.891621:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e257fa8da00 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:2.0:1788830618.891626:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8da00/0x575506951eea1767 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830618.891634:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8da00/0x575506951eea1767 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830618.891656:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9e25518dc900) 00010000:00010000:2.0:1788830618.891659:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788830618.891663:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8da00/0x575506951eea1767 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830618.891777:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8da00/0x575506951eea1767 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830618.891822:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8d000/0x575506951eea16a3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830618.891829:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8d000/0x575506951eea16a3 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830618.891834:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8d000/0x575506951eea16a3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830618.891839:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e257fa8d000 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:2.0:1788830618.891842:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8d000/0x575506951eea16a3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830618.891848:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8d000/0x575506951eea16a3 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830618.891856:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e257480c900) 00010000:00010000:2.0:1788830618.891858:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788830618.891861:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8d000/0x575506951eea16a3 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830618.891866:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8d000/0x575506951eea16a3 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830618.891897:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729a00/0x575506951eea176e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830618.891911:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944200/0x575506951eea16bf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661f44 expref: 21 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830618.891919:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729a00/0x575506951eea176e lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830618.891945:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944200/0x575506951eea16bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.21@tcp remote: 0xa578910534661f44 expref: 21 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830618.891960:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944200/0x575506951eea16bf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661f44 expref: 21 pid: 5832 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788830618.891970:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2445d41f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5833:1875724595176704:192.168.201.21@tcp:104: 00000100:00100000:2.0:1788830618.892042:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2565619a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788830618.895176:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830618.895191:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2445d41f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5833:1875724595176704:192.168.201.21@tcp:104: 00010000:00010000:3.0:1788830618.895239:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729a00/0x575506951eea176e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788830618.896074:0:11161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578405888 00000100:00100000:1.0:1788830618.896086:0:11161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578405888 00010000:00010000:1.0:1788830618.896136:0:11161:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944200/0x575506951eea16bf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661f44 expref: 22 pid: 5832 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788830618.896186:0:11161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 73 00000100:00100000:1.0:1788830618.896199:0:11161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2445d43480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+22:2355:x1875724578405888:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788830618.896218:0:11161:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788830618.896227:0:11161:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944200/0x575506951eea16bf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661f44 expref: 22 pid: 5832 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830618.896243:0:11161:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944200/0x575506951eea16bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661f44 expref: 22 pid: 5832 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830618.896270:0:11161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944200/0x575506951eea16bf lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661f44 expref: 22 pid: 5832 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830618.896290:0:11161:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e257480c900) 00010000:00010000:1.0:1788830618.896296:0:11161:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729a00/0x575506951eea176e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830618.896316:0:11161:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729a00/0x575506951eea176e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830618.896325:0:11161:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729a00/0x575506951eea176e lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830618.896357:0:11161:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788830618.896380:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729a00/0x575506951eea176e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830618.896391:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729a00/0x575506951eea176e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830618.896412:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729a00/0x575506951eea176e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830618.896429:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729a00/0x575506951eea176e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830618.896437:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729a00/0x575506951eea176e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788830618.896438:0:11161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2445d43480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+21:2355:x1875724578405888:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 239us (1274us total) trans 0 rc 0/0 00010000:00010000:3.0:1788830618.896450:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2565729a00 already unused, calling callback (ffffffffc1f0e4f0) 00000100:00100000:1.0:1788830618.896457:0:11161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 73 00010000:00010000:3.0:1788830618.896458:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729a00/0x575506951eea176e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830618.896469:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729a00/0x575506951eea176e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830618.896480:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e257480c900) 00010000:00010000:3.0:1788830618.896483:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788830618.896487:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729a00/0x575506951eea176e lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830618.896494:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729a00/0x575506951eea176e lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830618.896510:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8c400/0x575506951eea1760 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830618.896517:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8c400/0x575506951eea1760 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830618.896524:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8c400/0x575506951eea1760 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830618.896529:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e257fa8c400 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:3.0:1788830618.896539:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8c400/0x575506951eea1760 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830618.896547:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8c400/0x575506951eea1760 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830618.896554:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e257480c900) 00010000:00010000:3.0:1788830618.896557:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788830618.896559:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8c400/0x575506951eea1760 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830618.896565:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8c400/0x575506951eea1760 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788830618.897054:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2445d43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+20:11515:x1875724578405632:12345-192.168.201.21@tcp:57:lhsmtool_posix.0 Request processed in 12899us (13763us total) trans 4294967464 rc 0/0 00000100:00100000:2.0:1788830618.897068:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 185 00000020:00080000:2.0:1788830618.897075:0:5833:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1788830618.897176:0:11676:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788830618.897182:0:11676:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788830618.897799:0:11676:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1788830618.897808:0:11676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788830618.899982:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830618.900141:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578406144 00000100:00100000:1.0:1788830618.900153:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578406144 00000100:00100000:1.0:1788830618.900234:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 49 00000100:00100000:1.0:1788830618.900245:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25629b3850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+20:11515:x1875724578406144:12345-192.168.201.21@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788830618.901256:0:5835:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788830618.901426:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00010000:00010000:2.0:1788830618.902341:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728a00/0x575506951eea1775 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830618.902361:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728a00/0x575506951eea1775 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830618.902387:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728a00/0x575506951eea1775 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830618.902398:0:5835:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728a00/0x575506951eea1775 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830618.902406:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728a00/0x575506951eea1775 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830618.902413:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728a00/0x575506951eea1775 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830618.902437:0:5835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788830618.902471:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788830618.902485:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728a00/0x575506951eea1775 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830618.902495:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2565728a00 already unused, calling callback (ffffffffc14cb350) 00010000:00010000:1.0:1788830618.902500:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728a00/0x575506951eea1775 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830618.902510:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728a00/0x575506951eea1775 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830618.902530:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9e2551f3e500) 00010000:00010000:1.0:1788830618.902533:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788830618.902538:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728a00/0x575506951eea1775 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830618.902555:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728a00/0x575506951eea1775 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830618.902575:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788830618.902576:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788830618.902578:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788830618.903229:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25629b3850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+22:11515:x1875724578406144:12345-192.168.201.21@tcp:35:lhsmtool_posix.0 Request processed in 2979us (3253us total) trans 4294967466 rc 0/0 00000100:00100000:2.0:1788830618.903243:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 49 00000020:00080000:2.0:1788830618.903250:0:5835:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788830619.676225:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788830620.584650:0:12558:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788830620.584659:0:12558:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788830620.590312:0:12558:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:0.0:1788830620.590322:0:12558:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1788830620.703541:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788830620.747102:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830620.747267:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578406400 00000100:00100000:0.0:1788830620.747278:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578406400 00000100:00100000:0.0:1788830620.747375:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 186 00000100:00100000:0.0:1788830620.747386:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2445d00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+22:11533:x1875724578406400:12345-192.168.201.21@tcp:101:lfs.0 00010000:00010000:0.0:1788830620.747411:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788830620.747432:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e400/0x575506951eea177c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa578910534661f7c expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830620.747540:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f000/0x575506951eea1783 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830620.747570:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f000/0x575506951eea1783 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830620.747583:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f000/0x575506951eea1783 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788830620.747596:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1788830620.747787:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e400/0x575506951eea177c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661f7c expref: 25 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830620.747805:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f000/0x575506951eea1783 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661f7c expref: 24 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830620.747814:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e25530b0b00) 00010000:00010000:0.0:1788830620.747817:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788830620.747821:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2445b7f000, rc 0) 00000100:00100000:0.0:1788830620.747883:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2445d00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+24:11533:x1875724578406400:12345-192.168.201.21@tcp:101:lfs.0 Request processed in 498us (789us total) trans 4294967467 rc 0/0 00000100:00100000:0.0:1788830620.747900:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 186 00000100:00080000:2.0:1788830620.748470:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788830620.751216:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830620.751273:0:8202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578406528 00000100:00100000:0.0:1788830620.751281:0:8202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578406528 00000100:00100000:0.0:1788830620.751332:0:8202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 187 00000100:00100000:0.0:1788830620.751341:0:8202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2445d40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+24:11533:x1875724578406528:12345-192.168.201.21@tcp:34:lfs.0 00010000:00010000:0.0:1788830620.751525:0:8202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e200/0x575506951eea1791 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830620.751542:0:8202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e200/0x575506951eea1791 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830620.751553:0:8202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e200/0x575506951eea1791 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830620.751566:0:8202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea1798 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830620.751574:0:8202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea1798 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830620.751580:0:8202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea1798 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830620.751865:0:8202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea179f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830620.751872:0:8202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea179f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830620.751878:0:8202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea179f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788830620.751925:0:8202:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea179f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830620.751936:0:8202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e200/0x575506951eea1791 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830620.751942:0:8202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e200/0x575506951eea1791 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830620.751949:0:8202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e200/0x575506951eea1791 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830620.751956:0:8202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2445b7e200 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:0.0:1788830620.751960:0:8202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e200/0x575506951eea1791 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830620.751967:0:8202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e200/0x575506951eea1791 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830620.751977:0:8202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e25530b0b00) 00010000:00010000:0.0:1788830620.751980:0:8202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788830620.751984:0:8202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e200/0x575506951eea1791 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830620.751989:0:8202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e200/0x575506951eea1791 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830620.751999:0:8202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea1798 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830620.752005:0:8202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea1798 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830620.752015:0:8202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea1798 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830620.752020:0:8202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2445b7ee00 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:0.0:1788830620.752023:0:8202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea1798 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830620.752029:0:8202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea1798 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830620.752035:0:8202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9e25518dc200) 00010000:00010000:0.0:1788830620.752037:0:8202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788830620.752040:0:8202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea1798 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830620.752045:0:8202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea1798 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830620.752058:0:8202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea179f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830620.752063:0:8202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea179f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830620.752069:0:8202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea179f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830620.752074:0:8202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2445b7f800 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:0.0:1788830620.752076:0:8202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea179f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830620.752089:0:8202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea179f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830620.752096:0:8202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e25518dcf00) 00010000:00010000:0.0:1788830620.752098:0:8202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788830620.752100:0:8202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea179f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830620.752105:0:8202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea179f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788830620.752174:0:8202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2445d40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+24:11533:x1875724578406528:12345-192.168.201.21@tcp:34:lfs.0 Request processed in 833us (966us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830620.752183:0:8202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 187 00000100:00100000:0.0:1788830620.799036:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830620.799223:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578406784 00000100:00100000:1.0:1788830620.799233:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578406784 00000100:00100000:1.0:1788830620.799346:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 188 00000100:00100000:1.0:1788830620.799358:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257facad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+24:11536:x1875724578406784:12345-192.168.201.21@tcp:101:lfs.0 00010000:00010000:1.0:1788830620.799379:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788830620.799399:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8de00/0x575506951eea17a6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa578910534661f83 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830620.799472:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8c200/0x575506951eea17ad lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830620.799486:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8c200/0x575506951eea17ad lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830620.799498:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8c200/0x575506951eea17ad lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830620.799511:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8dc00/0x575506951eea17b4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830620.799519:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8dc00/0x575506951eea17b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830620.799539:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8dc00/0x575506951eea17b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830620.799816:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8c600/0x575506951eea17bb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830620.799825:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8c600/0x575506951eea17bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830620.799833:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8c600/0x575506951eea17bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788830620.799842:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:1.0:1788830620.799928:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8c200/0x575506951eea17ad lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830620.799936:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8c200/0x575506951eea17ad lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830620.799942:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8c200/0x575506951eea17ad lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830620.799947:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e257fa8c200 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:1.0:1788830620.799951:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8c200/0x575506951eea17ad lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830620.799959:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8c200/0x575506951eea17ad lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830620.799969:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e25530b0b00) 00010000:00010000:1.0:1788830620.799972:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788830620.799981:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8c200/0x575506951eea17ad lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830620.799987:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8c200/0x575506951eea17ad lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830620.799997:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8dc00/0x575506951eea17b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830620.800001:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8dc00/0x575506951eea17b4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830620.800008:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8dc00/0x575506951eea17b4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830620.800012:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e257fa8dc00 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:1.0:1788830620.800015:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8dc00/0x575506951eea17b4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830620.800020:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8dc00/0x575506951eea17b4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830620.800038:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9e257480ca00) 00010000:00010000:1.0:1788830620.800041:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788830620.800045:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8dc00/0x575506951eea17b4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830620.800051:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8dc00/0x575506951eea17b4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830620.800090:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8de00/0x575506951eea17a6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661f83 expref: 27 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830620.800113:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8c600/0x575506951eea17bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661f83 expref: 26 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830620.800120:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e257480ce00) 00010000:00010000:1.0:1788830620.800122:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788830620.800124:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e257fa8c600, rc 0) 00000100:00100000:1.0:1788830620.800188:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257facad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+26:11536:x1875724578406784:12345-192.168.201.21@tcp:101:lfs.0 Request processed in 833us (1170us total) trans 4294967468 rc 0/0 00000100:00100000:1.0:1788830620.800194:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 188 00000100:00100000:3.0:1788830620.805278:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830620.805385:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578406912 00000100:00100000:2.0:1788830620.805400:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578406912 00000100:00100000:2.0:1788830620.805476:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 189 00000100:00100000:2.0:1788830620.805487:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2544ee5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+26:11536:x1875724578406912:12345-192.168.201.21@tcp:54:lfs.0 00010000:00010000:2.0:1788830620.805558:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729a00/0x575506951eea17c9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830620.805575:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729a00/0x575506951eea17c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830620.805587:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729a00/0x575506951eea17c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830620.805631:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729a00/0x575506951eea17c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830620.805639:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729a00/0x575506951eea17c9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830620.805645:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729a00/0x575506951eea17c9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830620.805652:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2565729a00 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:2.0:1788830620.805655:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729a00/0x575506951eea17c9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830620.805663:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729a00/0x575506951eea17c9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830620.805675:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e257480ce00) 00010000:00010000:2.0:1788830620.805688:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788830620.805692:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729a00/0x575506951eea17c9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830620.805699:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729a00/0x575506951eea17c9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788830620.805828:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2544ee5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+26:11536:x1875724578406912:12345-192.168.201.21@tcp:54:lfs.0 Request processed in 343us (565us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830620.805836:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 189 00000100:00100000:0.0:1788830620.811416:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830620.811910:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578407168 00000100:00100000:3.0:1788830620.811921:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578407168 00000100:00100000:3.0:1788830620.811984:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 50 00000100:00100000:3.0:1788830620.811995:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257fac9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+26:11536:x1875724578407168:12345-192.168.201.21@tcp:35:lfs.0 00000100:00100000:3.0:1788830620.812997:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257fac9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+27:11536:x1875724578407168:12345-192.168.201.21@tcp:35:lfs.0 Request processed in 1000us (1586us total) trans 4294967469 rc 0/0 00000100:00100000:3.0:1788830620.813008:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 50 00000100:00100000:3.0:1788830620.831136:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830620.831250:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578407424 00000100:00100000:2.0:1788830620.831261:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578407424 00000100:00100000:2.0:1788830620.831321:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 190 00000100:00100000:2.0:1788830620.831346:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2544ee6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+27:11062:x1875724578407424:12345-192.168.201.21@tcp:101:bash.0 00010000:00010000:2.0:1788830620.831372:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788830620.831392:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729a00/0x575506951eea17d0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa578910534661f8a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830620.831486:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728e00/0x575506951eea17d7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830620.831501:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8c600/0x575506951eea17bb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661f83 expref: 28 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830620.831511:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728e00/0x575506951eea17d7 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830620.831542:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8c600/0x575506951eea17bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.21@tcp remote: 0xa578910534661f83 expref: 28 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830620.831556:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8c600/0x575506951eea17bb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661f83 expref: 28 pid: 5832 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788830620.831569:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2445d42a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5834:1875724595176832:192.168.201.21@tcp:104: 00000100:00100000:2.0:1788830620.831665:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2565619cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788830620.834023:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830620.834107:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578407552 00000100:00100000:0.0:1788830620.834115:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578407552 00010000:00010000:0.0:1788830620.834151:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8c600/0x575506951eea17bb lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661f83 expref: 29 pid: 5832 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788830620.834191:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 74 00000100:00100000:0.0:1788830620.834200:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2445d01880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+29:2355:x1875724578407552:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788830620.834215:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788830620.834222:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8c600/0x575506951eea17bb lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661f83 expref: 29 pid: 5832 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830620.834235:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8c600/0x575506951eea17bb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661f83 expref: 29 pid: 5832 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830620.834270:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e257480ce00) 00010000:00010000:0.0:1788830620.834275:0:5819:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728e00/0x575506951eea17d7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830620.834285:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728e00/0x575506951eea17d7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830620.834293:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728e00/0x575506951eea17d7 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830620.834310:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788830620.834369:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2445d01880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+29:2355:x1875724578407552:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 169us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830620.834377:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 74 00010000:00010000:2.0:1788830620.834779:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8c600/0x575506951eea17bb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661f83 expref: 28 pid: 5832 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788830620.834805:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2445d42a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5834:1875724595176832:192.168.201.21@tcp:104: 00010000:00010000:2.0:1788830620.834825:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728e00/0x575506951eea17d7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830620.834845:0:5834:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728e00/0x575506951eea17d7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830620.834852:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728e00/0x575506951eea17d7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788830620.834870:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:2.0:1788830620.835033:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729a00/0x575506951eea17d0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661f8a expref: 29 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830620.835048:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728e00/0x575506951eea17d7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661f8a expref: 28 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830620.835055:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e257480ce00) 00010000:00010000:2.0:1788830620.835057:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788830620.835060:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2565728e00, rc 0) 00000100:00100000:2.0:1788830620.835102:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2544ee6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+28:11062:x1875724578407424:12345-192.168.201.21@tcp:101:bash.0 Request processed in 3758us (3977us total) trans 4294967470 rc 0/0 00000100:00100000:2.0:1788830620.835110:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 190 00000100:00100000:1.0:1788830620.837770:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830620.837970:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578407808 00000100:00100000:2.0:1788830620.837979:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578407808 00000100:00100000:2.0:1788830620.838082:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 191 00000100:00100000:2.0:1788830620.838093:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2445d01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+28:11062:x1875724578407808:12345-192.168.201.21@tcp:36:bash.0 00010000:00010000:2.0:1788830620.838345:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729800/0x575506951eea17e5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830620.838362:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729800/0x575506951eea17e5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830620.838386:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729800/0x575506951eea17e5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788830620.838437:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967471 00000004:00010000:2.0:1788830620.838460:0:5833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000057570c49 reply state 0000000090a8d605 transno 4294967472 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729800/0x575506951eea17e5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788830620.838470:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1788830620.838511:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967472 00000100:00100000:2.0:1788830620.838607:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2445d01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+32:11062:x1875724578407808:12345-192.168.201.21@tcp:36:bash.0 Request processed in 515us (845us total) trans 4294967473 rc 0/0 00000100:00100000:2.0:1788830620.838615:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 191 00000020:00080000:2.0:1788830620.838619:0:5833:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1788830620.841036:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00010000:00010000:1.0:1788830620.841145:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729800/0x575506951eea17e5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830620.841157:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729800/0x575506951eea17e5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830620.841165:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729800/0x575506951eea17e5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830620.841172:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2565729800 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:1.0:1788830620.841176:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729800/0x575506951eea17e5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830620.841184:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729800/0x575506951eea17e5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830620.841200:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e257480ce00) 00010000:00010000:1.0:1788830620.841216:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788830620.841221:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729800/0x575506951eea17e5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830620.841228:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729800/0x575506951eea17e5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788830620.845617:0:8202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578407936 00000100:00100000:0.0:1788830620.845634:0:8202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578407936 00000100:00100000:0.0:1788830620.845752:0:8202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 192 00000100:00100000:0.0:1788830620.845764:0:8202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2544ee5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+31:11062:x1875724578407936:12345-192.168.201.21@tcp:101:bash.0 00010000:00010000:0.0:1788830620.845905:0:8202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788830620.845929:0:8202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e200/0x575506951eea17ec lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa578910534661f91 expref: -99 pid: 8202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830620.845993:0:8202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e200/0x575506951eea17ec lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661f91 expref: 32 pid: 8202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830620.846009:0:8202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e200/0x575506951eea17ec lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661f91 expref: 32 pid: 8202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830620.846050:0:8202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e257480ce00) 00010000:00010000:0.0:1788830620.846053:0:8202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788830620.846057:0:8202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2445b7e200, rc 0) 00000100:00100000:0.0:1788830620.846164:0:8202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2544ee5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+32:11062:x1875724578407936:12345-192.168.201.21@tcp:101:bash.0 Request processed in 403us (5137us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830620.846172:0:8202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 192 00000100:00100000:3.0:1788830620.853039:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830620.853207:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578408064 00000100:00100000:1.0:1788830620.853218:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578408064 00000100:00100000:1.0:1788830620.853282:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 60 00000100:00100000:1.0:1788830620.853293:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2544ee4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+7:11062:x1875724578408064:12345-192.168.201.21@tcp:101:bash.0 00010000:00010000:1.0:1788830620.853311:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788830620.853332:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000096b3d79/0x575506951eea17f3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa578910534661f98 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788830620.853359:0:6680:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a9f6399, atime: 0x6a9f6397, ctime: 0x6a9f6399, blocks: 0xb 00010000:00010000:1.0:1788830620.853380:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=374s v=(0 0) 00010000:00010000:1.0:1788830620.853385:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788830620.853392:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000096b3d79/0x575506951eea17f3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.21@tcp remote: 0xa578910534661f98 expref: 8 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830620.853408:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000096b3d79/0x575506951eea17f3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.21@tcp remote: 0xa578910534661f98 expref: 8 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830620.853421:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e257fa8d200, rc 0) 00000100:00100000:1.0:1788830620.853480:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2544ee4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+8:11062:x1875724578408064:12345-192.168.201.21@tcp:101:bash.0 Request processed in 189us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830620.853488:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 60 00000100:00080000:2.0:1788830620.853600:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788830620.856099:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830620.856325:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578408192 00000100:00100000:3.0:1788830620.856342:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578408192 00002000:00010000:3.0:1788830620.856397:0:6685:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:3.0:1788830620.856403:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e257facbb80 with x1875724578408192 ext(0->18446744073709551615) 00002000:00010000:3.0:1788830620.856419:0:6685:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e257facbb80. 00000100:00100000:3.0:1788830620.856526:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 5 00000100:00100000:3.0:1788830620.856537:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257facbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+8:2355:x1875724578408192:12345-192.168.201.21@tcp:10:bash.0 00002000:00010000:3.0:1788830620.856952:0:6685:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1788830620.856956:0:6685:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1788830617 -> 1788830620 00002000:00010000:3.0:1788830620.856959:0:6685:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 1788830615 -> 1788830615 00002000:00010000:3.0:1788830620.856962:0:6685:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1788830617 -> 1788830620 00002000:00010000:3.0:1788830620.856965:0:6685:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1788830620.857150:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257facbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+9:2355:x1875724578408192:12345-192.168.201.21@tcp:10:bash.0 Request processed in 607us (1053us total) trans 4294967318 rc 0/0 00000100:00100000:2.0:1788830620.857165:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 5 00002000:00010000:2.0:1788830620.857173:0:6685:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:2.0:1788830620.857176:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e257facbb80 with x1875724578408192 ext(0->18446744073709551615) 00002000:00010000:2.0:1788830620.857188:0:6685:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e257facbb80. 00000100:00100000:3.0:1788830620.910855:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830620.912871:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578408320 00000100:00100000:2.0:1788830620.912954:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578408320 00000100:00100000:2.0:1788830620.913069:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 193 00000100:00100000:2.0:1788830620.913083:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2544ee6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+32:11550:x1875724578408320:12345-192.168.201.21@tcp:34:lfs.0 00010000:00010000:2.0:1788830620.913193:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729a00/0x575506951eea17fa lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830620.913216:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729a00/0x575506951eea17fa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830620.913255:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729a00/0x575506951eea17fa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830620.913275:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729000/0x575506951eea1801 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830620.913284:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729000/0x575506951eea1801 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830620.913291:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729000/0x575506951eea1801 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830620.914166:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729800/0x575506951eea1808 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830620.914184:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729800/0x575506951eea1808 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830620.914196:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729800/0x575506951eea1808 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788830620.914257:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729800/0x575506951eea1808 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830620.914273:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729a00/0x575506951eea17fa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830620.914279:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729a00/0x575506951eea17fa lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830620.914286:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729a00/0x575506951eea17fa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830620.914305:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2565729a00 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:2.0:1788830620.914310:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729a00/0x575506951eea17fa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830620.914319:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729a00/0x575506951eea17fa lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830620.914334:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e25530b0b00) 00010000:00010000:2.0:1788830620.914337:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788830620.914342:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729a00/0x575506951eea17fa lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830620.914349:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729a00/0x575506951eea17fa lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830620.914435:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729000/0x575506951eea1801 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830620.914443:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729000/0x575506951eea1801 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830620.914449:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729000/0x575506951eea1801 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830620.914455:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2565729000 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:2.0:1788830620.914458:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729000/0x575506951eea1801 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830620.914463:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729000/0x575506951eea1801 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830620.914478:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9e2551f3ee00) 00010000:00010000:2.0:1788830620.914480:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788830620.914482:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729000/0x575506951eea1801 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830620.914487:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729000/0x575506951eea1801 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830620.914505:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729800/0x575506951eea1808 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830620.914512:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729800/0x575506951eea1808 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830620.914518:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729800/0x575506951eea1808 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830620.914523:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2565729800 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:2.0:1788830620.914526:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729800/0x575506951eea1808 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830620.914530:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729800/0x575506951eea1808 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830620.914535:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e257480ce00) 00010000:00010000:2.0:1788830620.914536:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788830620.914539:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729800/0x575506951eea1808 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830620.914542:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729800/0x575506951eea1808 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788830620.914889:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2544ee6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+32:11550:x1875724578408320:12345-192.168.201.21@tcp:34:lfs.0 Request processed in 1805us (4048us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830620.914900:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 193 00000100:00100000:3.0:1788830620.941251:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830620.941484:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578408576 00000100:00100000:2.0:1788830620.941499:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578408576 00000100:00100000:2.0:1788830620.941706:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 194 00000100:00100000:2.0:1788830620.941869:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2544ee4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+32:11553:x1875724578408576:12345-192.168.201.21@tcp:101:lfs.0 00010000:00010000:2.0:1788830620.941903:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788830620.941936:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729800/0x575506951eea180f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa578910534661f9f expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830620.942035:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729000/0x575506951eea1816 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830620.942054:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729000/0x575506951eea1816 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830620.942068:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729000/0x575506951eea1816 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830620.942085:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729a00/0x575506951eea181d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830620.942093:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729a00/0x575506951eea181d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830620.942100:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729a00/0x575506951eea181d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830620.942508:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728a00/0x575506951eea1824 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830620.942519:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728a00/0x575506951eea1824 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830620.942528:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728a00/0x575506951eea1824 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788830620.942540:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1788830620.942821:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729000/0x575506951eea1816 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830620.942830:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729000/0x575506951eea1816 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830620.942838:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729000/0x575506951eea1816 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830620.942846:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2565729000 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:2.0:1788830620.942851:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729000/0x575506951eea1816 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830620.942860:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729000/0x575506951eea1816 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830620.942875:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e25530b0b00) 00010000:00010000:2.0:1788830620.942878:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788830620.942883:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729000/0x575506951eea1816 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830620.942902:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729000/0x575506951eea1816 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830620.942919:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729a00/0x575506951eea181d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830620.942925:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729a00/0x575506951eea181d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830620.942931:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729a00/0x575506951eea181d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830620.942937:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2565729a00 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:2.0:1788830620.942940:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729a00/0x575506951eea181d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830620.942946:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729a00/0x575506951eea181d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830620.942952:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9e2551f3ee00) 00010000:00010000:2.0:1788830620.942955:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788830620.942957:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729a00/0x575506951eea181d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830620.942963:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729a00/0x575506951eea181d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830620.943013:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729800/0x575506951eea180f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661f9f expref: 35 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830620.943027:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728a00/0x575506951eea1824 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661f9f expref: 34 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830620.943041:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e257480ce00) 00010000:00010000:2.0:1788830620.943044:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788830620.943047:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2565728a00, rc 0) 00000100:00100000:2.0:1788830620.943234:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2544ee4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+34:11553:x1875724578408576:12345-192.168.201.21@tcp:101:lfs.0 Request processed in 1368us (1993us total) trans 4294967474 rc 0/0 00000100:00100000:1.0:1788830620.946702:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830620.946903:0:8202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578408704 00000100:00100000:3.0:1788830620.946919:0:8202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578408704 00000100:00100000:3.0:1788830620.946996:0:8202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 195 00000100:00100000:3.0:1788830620.947008:0:8202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2445d03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+35:11553:x1875724578408704:12345-192.168.201.21@tcp:54:lfs.0 00010000:00010000:3.0:1788830620.947114:0:8202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944000/0x575506951eea1832 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830620.947138:0:8202:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728e00/0x575506951eea17d7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661f8a expref: 35 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830620.947149:0:8202:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944000/0x575506951eea1832 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830620.947232:0:8202:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728e00/0x575506951eea17d7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.21@tcp remote: 0xa578910534661f8a expref: 35 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830620.947249:0:8202:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728e00/0x575506951eea17d7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661f8a expref: 35 pid: 5834 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788830620.947282:0:8202:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25654d4000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8202:1875724595176960:192.168.201.21@tcp:104: 00000100:00100000:3.0:1788830620.947612:0:8202:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e25531c3840 going to sleep for 11 seconds 00000100:00100000:0.0:1788830620.950194:0:8202:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25654d4000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8202:1875724595176960:192.168.201.21@tcp:104: 00010000:00010000:0.0:1788830620.950236:0:8202:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944000/0x575506951eea1832 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788830620.951561:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830620.951810:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578408960 00000100:00100000:3.0:1788830620.951825:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578408960 00000100:00100000:3.0:1788830620.951903:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 51 00000100:00100000:3.0:1788830620.951916:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2445d00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+36:5589:x1875724578408960:12345-192.168.201.21@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788830620.952430:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2445d00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+37:5589:x1875724578408960:12345-192.168.201.21@tcp:35:ldlm_bl.0 Request processed in 514us (889us total) trans 4294967475 rc 0/0 00000100:00100000:3.0:1788830620.952440:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 51 00000100:00100000:3.0:1788830620.954473:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830620.954647:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578409088 00000100:00100000:1.0:1788830620.954660:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578409088 00010000:00010000:1.0:1788830620.954759:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728e00/0x575506951eea17d7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661f8a expref: 37 pid: 5834 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788830620.954791:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 75 00000100:00100000:1.0:1788830620.954800:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255da68050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+37:2354:x1875724578409088:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788830620.954816:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788830620.954822:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728e00/0x575506951eea17d7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661f8a expref: 37 pid: 5834 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830620.954833:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728e00/0x575506951eea17d7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661f8a expref: 37 pid: 5834 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830620.954858:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728e00/0x575506951eea17d7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661f8a expref: 37 pid: 5834 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830620.954874:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e257480ce00) 00010000:00010000:1.0:1788830620.954879:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944000/0x575506951eea1832 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830620.954888:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944000/0x575506951eea1832 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830620.954894:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944000/0x575506951eea1832 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830620.954950:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788830620.955011:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255da68050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+36:2354:x1875724578409088:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 212us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830620.955018:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 75 00010000:00010000:3.0:1788830620.955493:0:8202:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944000/0x575506951eea1832 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830620.955504:0:8202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944000/0x575506951eea1832 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830620.955589:0:8202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944000/0x575506951eea1832 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830620.955596:0:8202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944000/0x575506951eea1832 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830620.955601:0:8202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944000/0x575506951eea1832 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830620.955605:0:8202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e257d944000 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:3.0:1788830620.955609:0:8202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944000/0x575506951eea1832 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830620.955626:0:8202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944000/0x575506951eea1832 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830620.955638:0:8202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e257480ce00) 00010000:00010000:3.0:1788830620.955641:0:8202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788830620.955644:0:8202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944000/0x575506951eea1832 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830620.955650:0:8202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944000/0x575506951eea1832 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788830620.956211:0:8202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2445d03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+35:11553:x1875724578408704:12345-192.168.201.21@tcp:54:lfs.0 Request processed in 9200us (9530us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830620.956223:0:8202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 195 00000100:00100000:2.0:1788830620.958233:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 194 00000100:00100000:3.0:1788830620.958684:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000040:00080000:1.0:1788830620.959114:0:11676:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788830620.959119:0:11676:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788830620.959339:0:11676:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1788830620.959344:0:11676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788830620.959614:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578409344 00000100:00100000:2.0:1788830620.959625:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578409344 00000100:00100000:2.0:1788830620.959825:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 52 00000100:00100000:2.0:1788830620.959836:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25654d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+34:11553:x1875724578409344:12345-192.168.201.21@tcp:35:lfs.0 00000100:00100000:2.0:1788830620.960116:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25654d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+35:11553:x1875724578409344:12345-192.168.201.21@tcp:35:lfs.0 Request processed in 280us (1442us total) trans 4294967476 rc 0/0 00000100:00100000:2.0:1788830620.960122:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 52 00000100:00100000:1.0:1788830621.055531:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830621.055761:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578409600 00000100:00100000:0.0:1788830621.055774:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578409600 00000100:00100000:0.0:1788830621.055844:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 196 00000100:00100000:0.0:1788830621.055853:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2445d00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+35:11564:x1875724578409600:12345-192.168.201.21@tcp:101:cat.0 00010000:00010000:0.0:1788830621.055883:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788830621.055910:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e400/0x575506951eea1839 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa578910534661fa6 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.056001:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea1840 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.056016:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea1840 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.056028:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea1840 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.056066:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea1847 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.056074:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea1847 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.056081:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea1847 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.056409:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6000/0x575506951eea184e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.056417:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6000/0x575506951eea184e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.056422:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6000/0x575506951eea184e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788830621.056431:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:0.0:1788830621.056542:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea1840 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.056563:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea1840 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.056571:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea1840 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.056578:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2445b7ee00 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:0.0:1788830621.056583:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea1840 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.056602:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea1840 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.056615:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e25530b0b00) 00010000:00010000:0.0:1788830621.056617:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788830621.056621:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea1840 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.056626:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ee00/0x575506951eea1840 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.057193:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea1847 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.057203:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea1847 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.057209:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea1847 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.057215:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2445b7f800 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:0.0:1788830621.057219:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea1847 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.057226:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea1847 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.057238:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9e25518dcf00) 00010000:00010000:0.0:1788830621.057241:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788830621.057244:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea1847 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.057264:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f800/0x575506951eea1847 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.057329:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e400/0x575506951eea1839 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661fa6 expref: 38 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.057347:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6000/0x575506951eea184e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661fa6 expref: 37 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.057356:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e257480ce00) 00010000:00010000:0.0:1788830621.057359:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788830621.057362:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e25658d6000, rc 0) 00000100:00100000:0.0:1788830621.057517:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2445d00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+37:11564:x1875724578409600:12345-192.168.201.21@tcp:101:cat.0 Request processed in 1662us (2001us total) trans 4294967477 rc 0/0 00000100:00100000:0.0:1788830621.057527:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 196 00000100:00100000:1.0:1788830621.067270:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830621.067387:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578409856 00000100:00100000:0.0:1788830621.067401:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578409856 00000100:00100000:0.0:1788830621.067478:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 53 00000100:00100000:0.0:1788830621.067491:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2445d01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+37:11564:x1875724578409856:12345-192.168.201.21@tcp:35:cat.0 00000100:00100000:0.0:1788830621.067877:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2445d01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+38:11564:x1875724578409856:12345-192.168.201.21@tcp:35:cat.0 Request processed in 389us (623us total) trans 4294967478 rc 0/0 00000100:00100000:0.0:1788830621.067883:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 53 00000100:00100000:3.0:1788830621.085861:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830621.086099:0:8202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578410112 00000100:00100000:0.0:1788830621.086114:0:8202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578410112 00000100:00100000:0.0:1788830621.086193:0:8202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 197 00000100:00100000:0.0:1788830621.086205:0:8202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25654d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+38:11565:x1875724578410112:12345-192.168.201.21@tcp:36:rm.0 00010000:00010000:0.0:1788830621.086331:0:8202:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788830621.086380:0:8202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6000/0x575506951eea184e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661fa6 expref: 38 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.086409:0:8202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728a00/0x575506951eea1824 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661f9f expref: 37 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.086423:0:8202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e200/0x575506951eea17ec lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661f91 expref: 36 pid: 8202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.086434:0:8202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e257480ce00) 00010000:00010000:0.0:1788830621.086447:0:8202:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788830621.086477:0:8202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6a00/0x575506951eea185c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.086495:0:8202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6a00/0x575506951eea185c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.086508:0:8202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6a00/0x575506951eea185c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.086526:0:8202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7200/0x575506951eea1863 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.086532:0:8202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7200/0x575506951eea1863 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.086539:0:8202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7200/0x575506951eea1863 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.086981:0:8202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6600/0x575506951eea186a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.086990:0:8202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6600/0x575506951eea186a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.086998:0:8202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6600/0x575506951eea186a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788830621.087665:0:8202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:0.0:1788830621.087695:0:8202:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 374434984665ns, next at 375434980810ns, rc = 0 00010000:00010000:0.0:1788830621.087862:0:8202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7c00/0x575506951eea1871 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.087873:0:8202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7c00/0x575506951eea1871 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.087882:0:8202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7c00/0x575506951eea1871 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.087891:0:8202:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7c00/0x575506951eea1871 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.087899:0:8202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7c00/0x575506951eea1871 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.087906:0:8202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7c00/0x575506951eea1871 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.087933:0:8202:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788830621.087961:0:8202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6600/0x575506951eea186a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.087977:0:8202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6600/0x575506951eea186a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.087984:0:8202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6600/0x575506951eea186a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.087991:0:8202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e25658d6600 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:0.0:1788830621.087997:0:8202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6600/0x575506951eea186a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.088006:0:8202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6600/0x575506951eea186a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.088018:0:8202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e25518dc200) 00010000:00010000:0.0:1788830621.088021:0:8202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788830621.088026:0:8202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6600/0x575506951eea186a lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.088032:0:8202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6600/0x575506951eea186a lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.088051:0:8202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6a00/0x575506951eea185c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.088058:0:8202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6a00/0x575506951eea185c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.088064:0:8202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6a00/0x575506951eea185c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.088070:0:8202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e25658d6a00 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:0.0:1788830621.088079:0:8202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6a00/0x575506951eea185c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.088086:0:8202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6a00/0x575506951eea185c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.088095:0:8202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e25530b0b00) 00010000:00010000:0.0:1788830621.088098:0:8202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788830621.088101:0:8202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6a00/0x575506951eea185c lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.088107:0:8202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6a00/0x575506951eea185c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788830621.088119:0:8202:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a4dfa1ed reply state 00000000e62452d5 transno 4294967479 ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7200/0x575506951eea1863 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788830621.088129:0:8202:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788830621.088251:0:8202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25654d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+37:11565:x1875724578410112:12345-192.168.201.21@tcp:36:rm.0 Request processed in 2044us (2404us total) trans 4294967479 rc 0/0 00010000:00010000:1.0:1788830621.088261:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1788830621.088261:0:8202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 197 00010000:00010000:1.0:1788830621.088269:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7c00/0x575506951eea1871 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830621.088276:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e25658d7c00 already unused, calling callback (ffffffffc14cb350) 00010000:00010000:1.0:1788830621.088290:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7c00/0x575506951eea1871 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830621.088297:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7c00/0x575506951eea1871 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830621.088321:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e25518dc200) 00010000:00010000:1.0:1788830621.088323:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788830621.088327:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7c00/0x575506951eea1871 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830621.088332:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7c00/0x575506951eea1871 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830621.088361:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788830621.088370:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788830621.088382:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788830621.093599:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7200/0x575506951eea1863 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830621.093624:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7200/0x575506951eea1863 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830621.093642:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7200/0x575506951eea1863 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830621.093648:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e25658d7200 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:2.0:1788830621.093654:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7200/0x575506951eea1863 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830621.093662:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7200/0x575506951eea1863 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830621.093742:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9e25518dcf00) 00010000:00010000:2.0:1788830621.093747:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788830621.093753:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7200/0x575506951eea1863 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830621.093759:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7200/0x575506951eea1863 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788830621.122854:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830621.122988:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578410368 00000100:00100000:2.0:1788830621.123000:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578410368 00000100:00100000:2.0:1788830621.123069:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 198 00000100:00100000:2.0:1788830621.123082:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25654d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+36:11571:x1875724578410368:12345-192.168.201.21@tcp:101:bash.0 00010000:00010000:2.0:1788830621.123116:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788830621.123142:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729800/0x575506951eea1878 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa578910534661fad expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830621.123294:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729a00/0x575506951eea187f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830621.123313:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729a00/0x575506951eea187f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830621.123328:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729a00/0x575506951eea187f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830621.123345:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729000/0x575506951eea1886 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830621.123353:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729000/0x575506951eea1886 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830621.123387:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729000/0x575506951eea1886 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788830621.124211:0:5834:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:2.0:1788830621.124498:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729400/0x575506951eea188d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830621.124511:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729400/0x575506951eea188d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830621.124523:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729400/0x575506951eea188d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830621.124565:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729a00/0x575506951eea187f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830621.124573:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729a00/0x575506951eea187f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830621.124580:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729a00/0x575506951eea187f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830621.124587:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2565729a00 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:2.0:1788830621.124592:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729a00/0x575506951eea187f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830621.124600:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729a00/0x575506951eea187f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830621.124614:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e25530b0b00) 00010000:00010000:2.0:1788830621.124617:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788830621.124628:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729a00/0x575506951eea187f lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830621.124633:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729a00/0x575506951eea187f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788830621.124645:0:5834:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005c2e25bb reply state 000000005e7680ad transno 4294967480 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729000/0x575506951eea1886 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788830621.124654:0:5834:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788830621.124705:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729800/0x575506951eea1878 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661fad expref: 39 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830621.124778:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729400/0x575506951eea188d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661fad expref: 38 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830621.124786:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e2551f3e000) 00010000:00010000:2.0:1788830621.124789:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788830621.124791:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2565729400, rc 0) 00000100:00100000:2.0:1788830621.124887:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25654d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+39:11571:x1875724578410368:12345-192.168.201.21@tcp:101:bash.0 Request processed in 1806us (2046us total) trans 4294967480 rc 0/0 00000100:00100000:2.0:1788830621.124896:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 198 00000100:00100000:1.0:1788830621.128262:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830621.128796:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578410496 00000100:00100000:3.0:1788830621.128810:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578410496 00000100:00100000:3.0:1788830621.128902:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 61 00000100:00100000:3.0:1788830621.128913:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2445d02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+5:2354:x1875724578410496:12345-192.168.201.21@tcp:101:bash.0 00010000:00010000:3.0:1788830621.128935:0:6677:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788830621.128960:0:6677:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ab0bf965/0x575506951eea189b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa578910534661fb4 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788830621.128994:0:6677:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788830621.129017:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=374s v=(0 0) 00010000:00010000:3.0:1788830621.129023:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788830621.129047:0:6677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ab0bf965/0x575506951eea189b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661fb4 expref: 6 pid: 6677 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830621.129072:0:6677:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ab0bf965/0x575506951eea189b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661fb4 expref: 6 pid: 6677 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830621.129088:0:6677:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e257d944000, rc 0) 00000100:00100000:3.0:1788830621.129159:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2445d02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+6:2354:x1875724578410496:12345-192.168.201.21@tcp:101:bash.0 Request processed in 249us (915us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830621.129167:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 61 00000100:00080000:2.0:1788830621.129353:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788830621.129501:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729000/0x575506951eea1886 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.129513:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729000/0x575506951eea1886 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.129521:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729000/0x575506951eea1886 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.129528:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2565729000 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:0.0:1788830621.129534:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729000/0x575506951eea1886 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.129556:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729000/0x575506951eea1886 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.129574:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9e2551f3ee00) 00010000:00010000:0.0:1788830621.129578:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788830621.129582:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729000/0x575506951eea1886 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.129589:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729000/0x575506951eea1886 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788830621.132615:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830621.132762:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578410624 00000100:00100000:1.0:1788830621.132775:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578410624 00000100:00100000:1.0:1788830621.132845:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 62 00000100:00100000:1.0:1788830621.132857:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25654d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+6:11571:x1875724578410624:12345-192.168.201.21@tcp:101:bash.0 00010000:00010000:1.0:1788830621.132880:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788830621.132907:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ad414220/0x575506951eea18a2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa578910534661fbb expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830621.132949:0:6680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ab0bf965/0x575506951eea189b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661fb4 expref: 7 pid: 6677 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830621.132959:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788830621.132965:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788830621.132971:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ad414220/0x575506951eea18a2 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661fbb expref: 7 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830621.133017:0:6680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ab0bf965/0x575506951eea189b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.21@tcp remote: 0xa578910534661fb4 expref: 7 pid: 6677 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830621.133030:0:6680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ab0bf965/0x575506951eea189b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661fb4 expref: 7 pid: 6677 timeout: 474 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788830621.133044:0:6680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2445d00000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6680:1875724595177088:192.168.201.21@tcp:104: 00000100:00100000:1.0:1788830621.133141:0:6680:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2548317000 going to sleep for 11 seconds 00000100:00100000:3.0:1788830621.136295:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830621.136365:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578410752 00000100:00100000:0.0:1788830621.136388:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578410752 00000100:00100000:1.0:1788830621.136430:0:6680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2445d00000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6680:1875724595177088:192.168.201.21@tcp:104: 00010000:00010000:0.0:1788830621.136441:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ab0bf965/0x575506951eea189b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661fb4 expref: 8 pid: 6677 timeout: 474 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830621.136469:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ad414220/0x575506951eea18a2 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.21@tcp remote: 0xa578910534661fbb expref: 8 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788830621.136491:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 76 00000100:00100000:0.0:1788830621.136501:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25654d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+8:2355:x1875724578410752:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788830621.136502:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e257fa8c800, rc 0) 00010000:00010000:0.0:1788830621.136521:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788830621.136563:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ab0bf965/0x575506951eea189b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661fb4 expref: 8 pid: 6677 timeout: 474 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.136577:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ab0bf965/0x575506951eea189b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661fb4 expref: 8 pid: 6677 timeout: 474 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788830621.136592:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25654d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+8:11571:x1875724578410624:12345-192.168.201.21@tcp:101:bash.0 Request processed in 3738us (3994us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830621.136600:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 62 00010000:00010000:0.0:1788830621.136608:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ab0bf965/0x575506951eea189b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661fb4 expref: 8 pid: 6677 timeout: 474 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.136655:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788830621.136661:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788830621.136684:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ad414220/0x575506951eea18a2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.21@tcp remote: 0xa578910534661fbb expref: 6 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.136695:0:5819:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ad414220/0x575506951eea18a2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.21@tcp remote: 0xa578910534661fbb expref: 6 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.136770:0:5819:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ad414220/0x575506951eea18a2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.21@tcp remote: 0xa578910534661fbb expref: 6 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788830621.136789:0:5819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257facb800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5819:1875724595177216:192.168.201.21@tcp:105: 00000100:00100000:0.0:1788830621.136871:0:5819:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2548034b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788830621.139647:0:5819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257facb800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5819:1875724595177216:192.168.201.21@tcp:105: 00010000:00010000:0.0:1788830621.139696:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788830621.139787:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25654d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+6:2355:x1875724578410752:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 3285us (3504us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830621.139801:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 76 00000100:00100000:2.0:1788830621.150235:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830621.150322:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578411008 00000100:00100000:0.0:1788830621.150338:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578411008 00000100:00100000:0.0:1788830621.150430:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 54 00000100:00100000:0.0:1788830621.150442:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2445d42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+38:11571:x1875724578411008:12345-192.168.201.21@tcp:35:bash.0 00000100:00100000:0.0:1788830621.151165:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2445d42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+39:11571:x1875724578411008:12345-192.168.201.21@tcp:35:bash.0 Request processed in 720us (942us total) trans 4294967481 rc 0/0 00000100:00100000:0.0:1788830621.151197:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 54 00000100:00100000:2.0:1788830621.316837:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830621.318834:0:8202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578411136 00000100:00100000:0.0:1788830621.318856:0:8202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578411136 00000100:00100000:0.0:1788830621.319028:0:8202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 199 00000100:00100000:0.0:1788830621.319042:0:8202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2445d42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+39:11587:x1875724578411136:12345-192.168.201.21@tcp:101:lfs.0 00010000:00010000:0.0:1788830621.319078:0:8202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788830621.319108:0:8202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6a00/0x575506951eea18a9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa578910534661fc2 expref: -99 pid: 8202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.319202:0:8202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6600/0x575506951eea18b0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.319221:0:8202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6600/0x575506951eea18b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.319235:0:8202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6600/0x575506951eea18b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788830621.319289:0:8202:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1788830621.319309:0:8202:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788830621.319334:0:8202:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6600/0x575506951eea18b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.319374:0:8202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6a00/0x575506951eea18a9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661fc2 expref: 41 pid: 8202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.319397:0:8202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6600/0x575506951eea18b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661fc2 expref: 40 pid: 8202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.319433:0:8202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e25530b0b00) 00010000:00010000:0.0:1788830621.319437:0:8202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788830621.319441:0:8202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e25658d6600, rc 0) 00000100:00100000:0.0:1788830621.319550:0:8202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2445d42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+40:11587:x1875724578411136:12345-192.168.201.21@tcp:101:lfs.0 Request processed in 501us (2719us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830621.319557:0:8202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 199 00000100:00100000:3.0:1788830621.324618:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830621.324702:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578411392 00000100:00100000:0.0:1788830621.324748:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578411392 00000100:00100000:0.0:1788830621.324877:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 200 00000100:00100000:0.0:1788830621.324890:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25654d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+40:11587:x1875724578411392:12345-192.168.201.21@tcp:101:lfs.0 00010000:00010000:0.0:1788830621.324917:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788830621.324945:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6000/0x575506951eea18b7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa578910534661fc9 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.325083:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6200/0x575506951eea18be lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.325101:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6200/0x575506951eea18be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.325114:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6200/0x575506951eea18be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788830621.325128:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1788830621.325324:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6000/0x575506951eea18b7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661fc9 expref: 43 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.325389:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6200/0x575506951eea18be lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661fc9 expref: 42 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.325400:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e2551f3e000) 00010000:00010000:0.0:1788830621.325403:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788830621.325407:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e25658d6200, rc 0) 00000100:00100000:0.0:1788830621.325503:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25654d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+42:11587:x1875724578411392:12345-192.168.201.21@tcp:101:lfs.0 Request processed in 615us (894us total) trans 4294967482 rc 0/0 00000100:00100000:0.0:1788830621.325511:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 200 00000100:00100000:3.0:1788830621.328530:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830621.330820:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830621.330918:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578411776 00000100:00100000:1.0:1788830621.330936:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578411776 00000100:00100000:1.0:1788830621.331652:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 15 00000100:00100000:1.0:1788830621.331681:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25654d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+42:2353:x1875724578411776:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788830621.331705:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788830621.331788:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6200/0x575506951eea18be lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661fc9 expref: 42 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830621.331815:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e2551f3e000) 00010000:00010000:1.0:1788830621.331821:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788830621.331891:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25654d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+41:2353:x1875724578411776:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 228us (1081us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830621.331899:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 15 00000100:00100000:2.0:1788830621.334734:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578411648 00000100:00100000:2.0:1788830621.334753:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578411648 00000100:00100000:2.0:1788830621.334839:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 201 00000100:00100000:2.0:1788830621.334850:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25654d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+41:11587:x1875724578411648:12345-192.168.201.21@tcp:101:lfs.0 00010000:00010000:2.0:1788830621.334956:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788830621.334995:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728c00/0x575506951eea18cc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa578910534661fd0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830621.335098:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729800/0x575506951eea18d3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830621.335113:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729800/0x575506951eea18d3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830621.335127:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729800/0x575506951eea18d3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788830621.335138:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1788830621.335467:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728c00/0x575506951eea18cc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661fd0 expref: 44 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830621.335487:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729800/0x575506951eea18d3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661fd0 expref: 43 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830621.335495:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e2551f3e000) 00010000:00010000:2.0:1788830621.335498:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788830621.335501:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2565729800, rc 0) 00000100:00100000:2.0:1788830621.336080:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25654d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+43:11587:x1875724578411648:12345-192.168.201.21@tcp:101:lfs.0 Request processed in 1228us (7557us total) trans 4294967483 rc 0/0 00000100:00100000:2.0:1788830621.336090:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 201 00000100:00100000:0.0:1788830621.343663:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830621.344466:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578411904 00000100:00100000:3.0:1788830621.344483:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578411904 00000100:00100000:3.0:1788830621.344564:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 63 00000100:00100000:3.0:1788830621.344579:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257facb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+6:2354:x1875724578411904:12345-192.168.201.21@tcp:1:lfs.0 00010000:00010000:3.0:1788830621.344624:0:6677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000073305c70/0x575506951eea18e1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830621.344646:0:6677:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ad414220/0x575506951eea18a2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.21@tcp remote: 0xa578910534661fbb expref: 6 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830621.344656:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788830621.344660:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788830621.344689:0:6677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000073305c70/0x575506951eea18e1 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830621.344857:0:6677:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ad414220/0x575506951eea18a2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.21@tcp remote: 0xa578910534661fbb expref: 6 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830621.344882:0:6677:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ad414220/0x575506951eea18a2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.21@tcp remote: 0xa578910534661fbb expref: 6 pid: 6680 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788830621.344897:0:6677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25654d6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6677:1875724595177344:192.168.201.21@tcp:104: 00000100:00100000:3.0:1788830621.345035:0:6677:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e25531c3840 going to sleep for 11 seconds 00000100:00100000:2.0:1788830621.364563:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830621.364677:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578412032 00000100:00100000:1.0:1788830621.364693:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578412032 00002000:00100000:1.0:1788830621.364812:0:6683:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9e2445d43800 x1875724578412032/t0(0) o4->1ef2fe7a-e5ec-4085-8326-b72aa00876cd@192.168.201.21@tcp:72/0 lens 504/0 e 0 to 0 dl 1788830632 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788830621.364827:0:6683:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e2445d43800 with x1875724578412032 ext(0->8) 00010000:00010000:1.0:1788830621.364855:0:6683:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000ad414220/0x575506951eea18a2 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.21@tcp remote: 0xa578910534661fbb expref: 7 pid: 6680 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830621.364875:0:6683:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000ad414220/0x575506951eea18a2 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.21@tcp remote: 0xa578910534661fbb expref: 7 pid: 6680 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788830621.364885:0:6683:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9e2445d43800 00000100:00100000:3.0:1788830621.364998:0:6677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25654d6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6677:1875724595177344:192.168.201.21@tcp:104: 00000100:00100000:1.0:1788830621.365019:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 3 00000100:00100000:1.0:1788830621.365033:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2445d43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+7:2354:x1875724578412032:12345-192.168.201.21@tcp:4:lfs.0 00010000:00010000:3.0:1788830621.365038:0:6677:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000073305c70/0x575506951eea18e1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788830621.365642:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2445d43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+9:2354:x1875724578412032:12345-192.168.201.21@tcp:4:lfs.0 Request processed in 609us (1097us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1788830621.365651:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 3 00002000:00100000:1.0:1788830621.365661:0:6683:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9e2445d43800 x1875724578412032/t4294967308(0) o4->1ef2fe7a-e5ec-4085-8326-b72aa00876cd@192.168.201.21@tcp:72/0 lens 504/448 e 0 to 0 dl 1788830632 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788830621.365682:0:6683:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e2445d43800 with x1875724578412032 ext(0->8) 00010000:00010000:1.0:1788830621.365689:0:6683:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000ad414220/0x575506951eea18a2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.21@tcp remote: 0xa578910534661fbb expref: 9 pid: 6680 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830621.365704:0:6683:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000ad414220/0x575506951eea18a2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.21@tcp remote: 0xa578910534661fbb expref: 9 pid: 6680 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788830621.365741:0:6683:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9e2445d43800 00000100:00100000:3.0:1788830621.369266:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830621.369328:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578412160 00000100:00100000:2.0:1788830621.369345:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578412160 00010000:00010000:2.0:1788830621.369416:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ad414220/0x575506951eea18a2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.21@tcp remote: 0xa578910534661fbb expref: 9 pid: 6680 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788830621.369488:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 77 00000100:00100000:2.0:1788830621.369499:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25654d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+9:2352:x1875724578412160:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788830621.369519:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1788830621.369546:0:5817:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1788830621.369549:0:5817:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788830620 00002000:00010000:2.0:1788830621.369552:0:5817:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788830621 00002000:00010000:2.0:1788830621.369554:0:5817:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1788830620 00010000:00010000:2.0:1788830621.369561:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ad414220/0x575506951eea18a2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.21@tcp remote: 0xa578910534661fbb expref: 9 pid: 6680 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830621.369577:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ad414220/0x575506951eea18a2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.21@tcp remote: 0xa578910534661fbb expref: 9 pid: 6680 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830621.369621:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ad414220/0x575506951eea18a2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.21@tcp remote: 0xa578910534661fbb expref: 9 pid: 6680 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830621.369643:0:5817:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788830621.369648:0:5817:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788830621.369654:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000073305c70/0x575506951eea18e1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830621.369665:0:5817:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000073305c70/0x575506951eea18e1 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830621.369770:0:6677:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000073305c70/0x575506951eea18e1 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830621.369773:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788830621.369790:0:6677:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000073305c70/0x575506951eea18e1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830621.369832:0:6677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000073305c70/0x575506951eea18e1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830621.369842:0:6677:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000073305c70/0x575506951eea18e1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788830621.369859:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25654d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+8:2352:x1875724578412160:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 360us (612us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830621.369871:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 77 00010000:00010000:3.0:1788830621.369890:0:6677:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000073305c70/0x575506951eea18e1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830621.369899:0:6677:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e257d944800 already unused, calling callback (ffffffffc14cb350) 00010000:00010000:3.0:1788830621.369904:0:6677:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000073305c70/0x575506951eea18e1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830621.369913:0:6677:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000073305c70/0x575506951eea18e1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830621.369936:0:6677:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000073305c70/0x575506951eea18e1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830621.369944:0:6677:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000073305c70/0x575506951eea18e1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788830621.370029:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257facb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+7:2354:x1875724578411904:12345-192.168.201.21@tcp:1:lfs.0 Request processed in 25452us (26442us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830621.370040:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 63 00000100:00100000:0.0:1788830621.372820:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830621.372995:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578412416 00000100:00100000:2.0:1788830621.373009:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578412416 00000100:00100000:2.0:1788830621.373086:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 55 00000100:00100000:2.0:1788830621.373097:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25629b0850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+43:11587:x1875724578412416:12345-192.168.201.21@tcp:35:lfs.0 00000004:00010000:2.0:1788830621.373194:0:5835:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729800/0x575506951eea18d3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661fd0 expref: 43 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788830621.373535:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967484 00000001:00080000:2.0:1788830621.373581:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967485 00000001:00080000:2.0:1788830621.374051:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00010000:00010000:2.0:1788830621.374119:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729000/0x575506951eea18e8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830621.374139:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729400/0x575506951eea188d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661fad expref: 47 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830621.374150:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729000/0x575506951eea18e8 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830621.374204:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729400/0x575506951eea188d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.21@tcp remote: 0xa578910534661fad expref: 47 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830621.374224:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729400/0x575506951eea188d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661fad expref: 47 pid: 5834 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788830621.374243:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2445d40700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5835:1875724595177472:192.168.201.21@tcp:104: 00000100:00100000:2.0:1788830621.374373:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e25656196c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788830621.381613:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830621.381799:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578412544 00000100:00100000:1.0:1788830621.381809:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578412544 00010000:00010000:1.0:1788830621.381853:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729400/0x575506951eea188d lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661fad expref: 48 pid: 5834 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788830621.381933:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 78 00000100:00100000:1.0:1788830621.381944:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257fac9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+48:2355:x1875724578412544:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788830621.381958:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788830621.381965:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729400/0x575506951eea188d lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661fad expref: 48 pid: 5834 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830621.381978:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729400/0x575506951eea188d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661fad expref: 48 pid: 5834 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830621.382002:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e2551f3e000) 00010000:00010000:1.0:1788830621.382007:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729000/0x575506951eea18e8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830621.382016:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729000/0x575506951eea18e8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830621.382023:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729000/0x575506951eea18e8 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830621.382042:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788830621.382095:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257fac9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+48:2355:x1875724578412544:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 154us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830621.382103:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 78 00010000:00010000:2.0:1788830621.384434:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729400/0x575506951eea188d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661fad expref: 47 pid: 5834 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788830621.384459:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2445d40700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5835:1875724595177472:192.168.201.21@tcp:104: 00010000:00010000:2.0:1788830621.384486:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729000/0x575506951eea18e8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830621.384495:0:5835:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729000/0x575506951eea18e8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830621.384501:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729000/0x575506951eea18e8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788830621.384654:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:2.0:1788830621.384994:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00000100:00100000:2.0:1788830621.385105:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2445d40700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5835:1875724595177600:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788830621.385173:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788830621.385200:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2565619300 going to sleep for 11 seconds 00000100:00100000:0.0:1788830621.385288:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595177600 00000100:00100000:0.0:1788830621.385297:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595177600 00000100:00100000:0.0:1788830621.385366:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788830621.385375:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2445d41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5835:x1875724595177600:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788830621.385466:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2445d41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5835:x1875724595177600:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 92us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830621.385473:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788830621.385699:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2445d40700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5835:1875724595177600:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1788830621.386211:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000100:00080000:2.0:1788830621.387095:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788830621.387443:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2445d00000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5835:1875724595177728:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788830621.387517:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830621.387552:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2548317480 going to sleep for 11 seconds 00000100:00100000:3.0:1788830621.388040:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595177728 00000100:00100000:3.0:1788830621.388057:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595177728 00000100:00100000:2.0:1788830621.390966:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788830621.390985:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2445d03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5835:x1875724595177728:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788830621.391409:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2445d03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5835:x1875724595177728:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 427us (3889us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1788830621.391420:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788830621.391489:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2445d00000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5835:1875724595177728:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1788830621.391589:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00010000:00010000:1.0:1788830621.391676:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729000/0x575506951eea18e8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830621.391688:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729000/0x575506951eea18e8 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830621.391696:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729000/0x575506951eea18e8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830621.391704:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2565729000 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:1.0:1788830621.391745:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729000/0x575506951eea18e8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830621.391754:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729000/0x575506951eea18e8 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830621.391769:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e2551f3e000) 00010000:00010000:1.0:1788830621.391772:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1788830621.391777:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729000/0x575506951eea18e8 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830621.391783:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729000/0x575506951eea18e8 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788830621.392388:0:5835:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1788830621.392495:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:1.0:1788830621.392507:0:5835:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 374739796768ns, next at 375739794868ns, rc = 0 00000001:00080000:1.0:1788830621.392527:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00010000:00010000:1.0:1788830621.392566:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e2551f3e000) 00010000:00010000:1.0:1788830621.392569:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788830621.392576:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729800/0x575506951eea18d3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661fd0 expref: 51 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788830621.392950:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25629b0850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+50:11587:x1875724578412416:12345-192.168.201.21@tcp:35:lfs.0 Request processed in 19851us (20142us total) trans 4294967492 rc 0/0 00000100:00100000:1.0:1788830621.392961:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 55 00000020:00080000:1.0:1788830621.392967:0:5835:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1788830621.397120:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830621.397208:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578412672 00000100:00100000:3.0:1788830621.397220:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578412672 00000100:00100000:3.0:1788830621.397309:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 202 00000100:00100000:3.0:1788830621.397325:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2445d41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+50:11587:x1875724578412672:12345-192.168.201.21@tcp:101:lfs.0 00010000:00010000:3.0:1788830621.397378:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788830621.397408:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944800/0x575506951eea18ef lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa578910534661fd7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830621.397490:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944800/0x575506951eea18ef lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661fd7 expref: 51 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830621.397508:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944800/0x575506951eea18ef lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661fd7 expref: 51 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830621.397529:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e25530b0f00) 00010000:00010000:3.0:1788830621.397533:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788830621.397536:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e257d944800, rc 0) 00000100:00100000:3.0:1788830621.397921:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2445d41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+51:11587:x1875724578412672:12345-192.168.201.21@tcp:101:lfs.0 Request processed in 599us (815us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830621.397929:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 202 00000100:00100000:2.0:1788830621.402141:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830621.402237:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578412928 00000100:00100000:0.0:1788830621.402250:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578412928 00000100:00100000:0.0:1788830621.402328:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 56 00000100:00100000:0.0:1788830621.402341:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2445d42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+51:11587:x1875724578412928:12345-192.168.201.21@tcp:35:lfs.0 00000100:00100000:0.0:1788830621.402681:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2445d42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+52:11587:x1875724578412928:12345-192.168.201.21@tcp:35:lfs.0 Request processed in 331us (544us total) trans 4294967493 rc 0/0 00000100:00100000:0.0:1788830621.402742:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 56 00000100:00100000:1.0:1788830621.470537:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830621.470744:0:8202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578413056 00000100:00100000:0.0:1788830621.470758:0:8202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578413056 00000100:00100000:0.0:1788830621.470837:0:8202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 203 00000100:00100000:0.0:1788830621.470849:0:8202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2445d00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+52:11597:x1875724578413056:12345-192.168.201.21@tcp:34:lfs.0 00010000:00010000:0.0:1788830621.470964:0:8202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6400/0x575506951eea18f6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.470982:0:8202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6400/0x575506951eea18f6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.470993:0:8202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6400/0x575506951eea18f6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.471006:0:8202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7a00/0x575506951eea18fd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.471011:0:8202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7a00/0x575506951eea18fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.471015:0:8202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7a00/0x575506951eea18fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.471120:0:8202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6800/0x575506951eea1904 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.471125:0:8202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6800/0x575506951eea1904 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.471128:0:8202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6800/0x575506951eea1904 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788830621.471191:0:8202:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6800/0x575506951eea1904 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.471203:0:8202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6400/0x575506951eea18f6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.471208:0:8202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6400/0x575506951eea18f6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.471214:0:8202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6400/0x575506951eea18f6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.471218:0:8202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e25658d6400 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:0.0:1788830621.471221:0:8202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6400/0x575506951eea18f6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.471226:0:8202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6400/0x575506951eea18f6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.471236:0:8202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e25530b0b00) 00010000:00010000:0.0:1788830621.471238:0:8202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788830621.471242:0:8202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6400/0x575506951eea18f6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.471245:0:8202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6400/0x575506951eea18f6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.471256:0:8202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7a00/0x575506951eea18fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.471259:0:8202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7a00/0x575506951eea18fd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.471267:0:8202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7a00/0x575506951eea18fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.471270:0:8202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e25658d7a00 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:0.0:1788830621.471272:0:8202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7a00/0x575506951eea18fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.471275:0:8202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7a00/0x575506951eea18fd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.471280:0:8202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9e25518dcb00) 00010000:00010000:0.0:1788830621.471281:0:8202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788830621.471282:0:8202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7a00/0x575506951eea18fd lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.471285:0:8202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7a00/0x575506951eea18fd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.471298:0:8202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6800/0x575506951eea1904 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.471303:0:8202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6800/0x575506951eea1904 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.471309:0:8202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6800/0x575506951eea1904 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.471314:0:8202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e25658d6800 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:0.0:1788830621.471317:0:8202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6800/0x575506951eea1904 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.471333:0:8202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6800/0x575506951eea1904 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.471342:0:8202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e25530b0f00) 00010000:00010000:0.0:1788830621.471344:0:8202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788830621.471347:0:8202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6800/0x575506951eea1904 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.471352:0:8202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6800/0x575506951eea1904 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788830621.471462:0:8202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2445d00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+52:11597:x1875724578413056:12345-192.168.201.21@tcp:34:lfs.0 Request processed in 614us (941us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830621.471471:0:8202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 203 00000100:00100000:2.0:1788830621.514105:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830621.514323:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578413312 00000100:00100000:3.0:1788830621.514337:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578413312 00000100:00100000:3.0:1788830621.514403:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 204 00000100:00100000:3.0:1788830621.514416:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2445d40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+52:11600:x1875724578413312:12345-192.168.201.21@tcp:101:lfs.0 00010000:00010000:3.0:1788830621.514446:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788830621.514474:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945400/0x575506951eea190b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa578910534661fde expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830621.514587:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944000/0x575506951eea1912 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830621.514605:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944000/0x575506951eea1912 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830621.514625:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944000/0x575506951eea1912 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830621.514638:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944200/0x575506951eea1919 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830621.514643:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944200/0x575506951eea1919 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830621.514647:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944200/0x575506951eea1919 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830621.514850:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945200/0x575506951eea1920 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830621.514857:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945200/0x575506951eea1920 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830621.514861:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945200/0x575506951eea1920 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788830621.514870:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1788830621.514987:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944000/0x575506951eea1912 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830621.514993:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944000/0x575506951eea1912 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830621.514998:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944000/0x575506951eea1912 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830621.515002:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e257d944000 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:3.0:1788830621.515011:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944000/0x575506951eea1912 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830621.515017:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944000/0x575506951eea1912 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830621.515028:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e25530b0b00) 00010000:00010000:3.0:1788830621.515031:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788830621.515035:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944000/0x575506951eea1912 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830621.515041:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944000/0x575506951eea1912 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830621.515059:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944200/0x575506951eea1919 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830621.515065:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944200/0x575506951eea1919 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830621.515071:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944200/0x575506951eea1919 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830621.515077:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e257d944200 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:3.0:1788830621.515080:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944200/0x575506951eea1919 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830621.515086:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944200/0x575506951eea1919 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830621.515093:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9e25530b0c00) 00010000:00010000:3.0:1788830621.515094:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788830621.515101:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944200/0x575506951eea1919 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830621.515105:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944200/0x575506951eea1919 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830621.515144:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945400/0x575506951eea190b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661fde expref: 55 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830621.515155:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945200/0x575506951eea1920 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661fde expref: 54 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830621.515161:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e25530b0f00) 00010000:00010000:3.0:1788830621.515162:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788830621.515164:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e257d945200, rc 0) 00000100:00100000:3.0:1788830621.515231:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2445d40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+54:11600:x1875724578413312:12345-192.168.201.21@tcp:101:lfs.0 Request processed in 819us (1142us total) trans 4294967494 rc 0/0 00000100:00100000:3.0:1788830621.515242:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 204 00000100:00100000:2.0:1788830621.519662:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830621.520078:0:8202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578413440 00000100:00100000:0.0:1788830621.520093:0:8202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578413440 00000100:00100000:0.0:1788830621.520162:0:8202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 205 00000100:00100000:0.0:1788830621.520176:0:8202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2445d42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+54:11600:x1875724578413440:12345-192.168.201.21@tcp:54:lfs.0 00010000:00010000:0.0:1788830621.520270:0:8202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6800/0x575506951eea192e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.520287:0:8202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6800/0x575506951eea192e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.520300:0:8202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6800/0x575506951eea192e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.520335:0:8202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6800/0x575506951eea192e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.520364:0:8202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6800/0x575506951eea192e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.520372:0:8202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6800/0x575506951eea192e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.520380:0:8202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e25658d6800 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:0.0:1788830621.520386:0:8202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6800/0x575506951eea192e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.520396:0:8202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6800/0x575506951eea192e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.520411:0:8202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e25530b0f00) 00010000:00010000:0.0:1788830621.520414:0:8202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788830621.520418:0:8202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6800/0x575506951eea192e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.520422:0:8202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6800/0x575506951eea192e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788830621.520507:0:8202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2445d42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+54:11600:x1875724578413440:12345-192.168.201.21@tcp:54:lfs.0 Request processed in 333us (862us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830621.520516:0:8202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 205 00000100:00100000:1.0:1788830621.524951:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830621.525059:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578413696 00000100:00100000:0.0:1788830621.525073:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578413696 00000100:00100000:0.0:1788830621.525183:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 57 00000100:00100000:0.0:1788830621.525197:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2445d01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+54:11600:x1875724578413696:12345-192.168.201.21@tcp:35:lfs.0 00000100:00100000:0.0:1788830621.525516:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2445d01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+55:11600:x1875724578413696:12345-192.168.201.21@tcp:35:lfs.0 Request processed in 320us (578us total) trans 4294967495 rc 0/0 00000100:00100000:0.0:1788830621.525550:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 57 00000100:00100000:2.0:1788830621.600614:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830621.600789:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578413952 00000100:00100000:0.0:1788830621.600803:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578413952 00000100:00100000:0.0:1788830621.600885:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 206 00000100:00100000:0.0:1788830621.600900:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2445d41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+55:11610:x1875724578413952:12345-192.168.201.21@tcp:101:bash.0 00010000:00010000:0.0:1788830621.600935:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788830621.600939:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788830621.600973:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6600/0x575506951eea18b0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661fc2 expref: 55 pid: 8202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.600998:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e25530b0b00) 00010000:00010000:0.0:1788830621.601004:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788830621.601020:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6800/0x575506951eea1935 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa578910534661fe5 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.601164:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7a00/0x575506951eea193c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.601181:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945200/0x575506951eea1920 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661fde expref: 55 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.601190:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7a00/0x575506951eea193c lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.601238:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945200/0x575506951eea1920 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.21@tcp remote: 0xa578910534661fde expref: 55 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.601254:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945200/0x575506951eea1920 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661fde expref: 55 pid: 5834 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788830621.601293:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257fac9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5832:1875724595177856:192.168.201.21@tcp:104: 00000100:00100000:0.0:1788830621.601418:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2548034600 going to sleep for 11 seconds 00000100:00100000:2.0:1788830621.610950:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830621.611856:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257fac9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5832:1875724595177856:192.168.201.21@tcp:104: 00010000:00010000:0.0:1788830621.611897:0:5832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7a00/0x575506951eea193c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788830621.612044:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578414080 00000100:00100000:1.0:1788830621.612054:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578414080 00010000:00010000:1.0:1788830621.612108:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945200/0x575506951eea1920 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661fde expref: 56 pid: 5834 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788830621.612167:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 79 00000100:00100000:1.0:1788830621.612178:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2445d43480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+56:2355:x1875724578414080:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788830621.612197:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788830621.612205:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945200/0x575506951eea1920 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661fde expref: 56 pid: 5834 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830621.612218:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945200/0x575506951eea1920 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661fde expref: 56 pid: 5834 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830621.612245:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945200/0x575506951eea1920 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661fde expref: 56 pid: 5834 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830621.612290:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e25530b0f00) 00010000:00010000:1.0:1788830621.612296:0:5819:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7a00/0x575506951eea193c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830621.612307:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7a00/0x575506951eea193c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830621.612316:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7a00/0x575506951eea193c lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830621.612346:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788830621.612430:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2445d43480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+55:2355:x1875724578414080:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 253us (1495us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830621.612438:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 79 00010000:00010000:0.0:1788830621.612505:0:5832:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7a00/0x575506951eea193c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.612513:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7a00/0x575506951eea193c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788830621.612537:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1788830621.612796:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6800/0x575506951eea1935 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661fe5 expref: 56 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.612815:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7a00/0x575506951eea193c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661fe5 expref: 55 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.612824:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e25530b0f00) 00010000:00010000:0.0:1788830621.612828:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788830621.612830:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e25658d7a00, rc 0) 00000100:00100000:0.0:1788830621.612858:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2445d41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+55:11610:x1875724578413952:12345-192.168.201.21@tcp:101:bash.0 Request processed in 11963us (12260us total) trans 4294967496 rc 0/0 00000100:00100000:0.0:1788830621.612863:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 206 00000100:00100000:1.0:1788830621.620093:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830621.620212:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578414336 00000100:00100000:2.0:1788830621.620226:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578414336 00000100:00100000:2.0:1788830621.620299:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 207 00000100:00100000:2.0:1788830621.620311:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2445d01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+55:11610:x1875724578414336:12345-192.168.201.21@tcp:36:bash.0 00010000:00010000:2.0:1788830621.620686:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728a00/0x575506951eea194a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830621.621131:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728a00/0x575506951eea194a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830621.621150:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728a00/0x575506951eea194a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788830621.621242:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967497 00000004:00010000:2.0:1788830621.621273:0:5833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000028994337 reply state 0000000069a59760 transno 4294967498 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728a00/0x575506951eea194a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788830621.621285:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788830621.621419:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2445d01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+58:11610:x1875724578414336:12345-192.168.201.21@tcp:36:bash.0 Request processed in 1107us (1337us total) trans 4294967498 rc 0/0 00000100:00100000:2.0:1788830621.621428:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 207 00000020:00080000:2.0:1788830621.621435:0:5833:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788830621.624003:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728a00/0x575506951eea194a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830621.624028:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728a00/0x575506951eea194a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830621.624063:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728a00/0x575506951eea194a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830621.624070:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2565728a00 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:2.0:1788830621.624077:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728a00/0x575506951eea194a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830621.624088:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728a00/0x575506951eea194a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830621.624111:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e25530b0f00) 00010000:00010000:2.0:1788830621.624115:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788830621.624121:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728a00/0x575506951eea194a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788830621.624226:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00010000:00010000:2.0:1788830621.624328:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728a00/0x575506951eea194a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788830621.624784:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578414464 00000100:00100000:3.0:1788830621.624798:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578414464 00000100:00100000:3.0:1788830621.624873:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 208 00000100:00100000:3.0:1788830621.624885:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2445d03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+57:11610:x1875724578414464:12345-192.168.201.21@tcp:101:bash.0 00010000:00010000:3.0:1788830621.624924:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788830621.624948:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945400/0x575506951eea1951 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa578910534661fec expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830621.625056:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944200/0x575506951eea1958 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830621.625086:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7a00/0x575506951eea193c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661fe5 expref: 58 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830621.625095:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944200/0x575506951eea1958 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830621.625137:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7a00/0x575506951eea193c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.21@tcp remote: 0xa578910534661fe5 expref: 58 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830621.625154:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7a00/0x575506951eea193c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661fe5 expref: 58 pid: 5832 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788830621.625172:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25654d6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5834:1875724595177984:192.168.201.21@tcp:104: 00000100:00100000:3.0:1788830621.625296:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e25531c3840 going to sleep for 11 seconds 00000100:00100000:2.0:1788830621.629344:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25654d6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5834:1875724595177984:192.168.201.21@tcp:104: 00010000:00010000:2.0:1788830621.629395:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944200/0x575506951eea1958 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788830621.633160:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830621.633791:0:11161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578414592 00000100:00100000:3.0:1788830621.633805:0:11161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578414592 00010000:00010000:3.0:1788830621.633861:0:11161:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7a00/0x575506951eea193c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661fe5 expref: 59 pid: 5832 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788830621.634371:0:11161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 80 00000100:00100000:3.0:1788830621.634387:0:11161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2544ee5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+59:2354:x1875724578414592:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788830621.634408:0:11161:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788830621.634417:0:11161:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7a00/0x575506951eea193c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661fe5 expref: 59 pid: 5832 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830621.634433:0:11161:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7a00/0x575506951eea193c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661fe5 expref: 59 pid: 5832 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830621.634483:0:11161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7a00/0x575506951eea193c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661fe5 expref: 59 pid: 5832 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830621.634504:0:11161:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e25530b0f00) 00010000:00010000:3.0:1788830621.634510:0:11161:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944200/0x575506951eea1958 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830621.634521:0:11161:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944200/0x575506951eea1958 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830621.634530:0:11161:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944200/0x575506951eea1958 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830621.634568:0:11161:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788830621.634653:0:11161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2544ee5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+58:2354:x1875724578414592:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 270us (1509us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830621.634671:0:11161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 80 00010000:00010000:2.0:1788830621.634750:0:5834:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944200/0x575506951eea1958 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830621.634760:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944200/0x575506951eea1958 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788830621.634819:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1788830621.634824:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788830621.634869:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944200/0x575506951eea1958 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830621.635828:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945400/0x575506951eea1951 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661fec expref: 58 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830621.636370:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944200/0x575506951eea1958 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661fec expref: 57 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830621.636381:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e25530b0f00) 00010000:00010000:2.0:1788830621.636384:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788830621.636387:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e257d944200, rc 0) 00000100:00100000:2.0:1788830621.636474:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2445d03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+57:11610:x1875724578414464:12345-192.168.201.21@tcp:101:bash.0 Request processed in 11590us (12252us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830621.636484:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 208 00000100:00100000:0.0:1788830621.642089:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830621.644859:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578414848 00000100:00100000:1.0:1788830621.644882:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578414848 00000100:00100000:1.0:1788830621.644968:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 58 00000100:00100000:1.0:1788830621.644980:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257fac9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+57:11610:x1875724578414848:12345-192.168.201.21@tcp:35:bash.0 00000100:00100000:1.0:1788830621.646970:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257fac9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+58:11610:x1875724578414848:12345-192.168.201.21@tcp:35:bash.0 Request processed in 1911us (5142us total) trans 4294967499 rc 0/0 00000100:00100000:1.0:1788830621.646985:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 58 00010000:00010000:1.0:1788830621.725941:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788830621.726203:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830621.726772:0:8202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578414976 00000100:00100000:3.0:1788830621.726789:0:8202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578414976 00000100:00100000:3.0:1788830621.727130:0:8202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 209 00000100:00100000:3.0:1788830621.727146:0:8202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257e924700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+58:11616:x1875724578414976:12345-192.168.201.21@tcp:101:lfs.0 00010000:00010000:3.0:1788830621.727180:0:8202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788830621.727207:0:8202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944000/0x575506951eea195f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa578910534661ff3 expref: -99 pid: 8202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830621.727309:0:8202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945c00/0x575506951eea1966 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830621.727345:0:8202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945c00/0x575506951eea1966 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830621.727359:0:8202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945c00/0x575506951eea1966 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788830621.727407:0:8202:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:3.0:1788830621.727411:0:8202:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788830621.727435:0:8202:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945c00/0x575506951eea1966 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830621.727466:0:8202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944000/0x575506951eea195f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661ff3 expref: 60 pid: 8202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830621.727549:0:8202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945c00/0x575506951eea1966 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661ff3 expref: 59 pid: 8202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830621.727560:0:8202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e25530b0b00) 00010000:00010000:3.0:1788830621.727563:0:8202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788830621.727567:0:8202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e257d945c00, rc 0) 00000100:00100000:3.0:1788830621.727671:0:8202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257e924700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+59:11616:x1875724578414976:12345-192.168.201.21@tcp:101:lfs.0 Request processed in 522us (1470us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830621.727679:0:8202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 209 00000100:00100000:2.0:1788830621.733948:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830621.734094:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578415104 00000100:00100000:0.0:1788830621.734108:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578415104 00000100:00100000:0.0:1788830621.734321:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 210 00000100:00100000:0.0:1788830621.734333:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2445d41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+59:11616:x1875724578415104:12345-192.168.201.21@tcp:101:lfs.0 00010000:00010000:0.0:1788830621.734360:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788830621.734385:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7600/0x575506951eea196d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa578910534661ffa expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.734472:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6c00/0x575506951eea1974 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.734491:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6c00/0x575506951eea1974 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.734506:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6c00/0x575506951eea1974 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.734523:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7400/0x575506951eea197b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.734531:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7400/0x575506951eea197b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.734538:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7400/0x575506951eea197b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.734656:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7800/0x575506951eea1982 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.734676:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7800/0x575506951eea1982 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.734700:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7800/0x575506951eea1982 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788830621.735128:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1788830621.735134:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788830621.735159:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7800/0x575506951eea1982 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.735172:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7800/0x575506951eea1982 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.735181:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6c00/0x575506951eea1974 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.735188:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6c00/0x575506951eea1974 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.735195:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6c00/0x575506951eea1974 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.735201:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e25658d6c00 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:0.0:1788830621.735205:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6c00/0x575506951eea1974 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.735214:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6c00/0x575506951eea1974 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.735227:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e25530b0b00) 00010000:00010000:0.0:1788830621.735231:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788830621.735235:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6c00/0x575506951eea1974 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.735254:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6c00/0x575506951eea1974 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.735271:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7400/0x575506951eea197b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.735278:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7400/0x575506951eea197b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.735284:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7400/0x575506951eea197b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.735289:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e25658d7400 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:0.0:1788830621.735293:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7400/0x575506951eea197b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.735299:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7400/0x575506951eea197b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.735308:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9e25518dcb00) 00010000:00010000:0.0:1788830621.735310:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788830621.735313:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7400/0x575506951eea197b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.735319:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7400/0x575506951eea197b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.735359:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7600/0x575506951eea196d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661ffa expref: 61 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.735373:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7800/0x575506951eea1982 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661ffa expref: 60 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.735387:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e25530b0f00) 00010000:00010000:0.0:1788830621.735389:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788830621.735392:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e25658d7800, rc 0) 00000100:00100000:0.0:1788830621.735484:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2445d41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+60:11616:x1875724578415104:12345-192.168.201.21@tcp:101:lfs.0 Request processed in 1153us (1549us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830621.735492:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 210 00000100:00100000:3.0:1788830621.740053:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830621.740119:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830621.740446:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578415232 00000100:00100000:1.0:1788830621.740460:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578415232 00000100:00100000:1.0:1788830621.740567:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 16 00000100:00100000:1.0:1788830621.740580:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255da69c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+60:2355:x1875724578415232:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788830621.740602:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788830621.740637:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7800/0x575506951eea1982 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661ffa expref: 60 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830621.740672:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e25530b0f00) 00010000:00010000:1.0:1788830621.740678:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788830621.740787:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578415488 00000100:00100000:2.0:1788830621.740793:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578415488 00000100:00100000:1.0:1788830621.740800:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255da69c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+60:2355:x1875724578415232:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 221us (761us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830621.740809:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 16 00000100:00100000:2.0:1788830621.740835:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 211 00000100:00100000:2.0:1788830621.740845:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25654d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+59:11616:x1875724578415488:12345-192.168.201.21@tcp:101:lfs.0 00010000:00010000:2.0:1788830621.740870:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788830621.740892:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728e00/0x575506951eea1989 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa578910534662001 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830621.741026:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728a00/0x575506951eea1990 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830621.741043:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944200/0x575506951eea1958 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661fec expref: 60 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830621.741064:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728a00/0x575506951eea1990 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830621.741127:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944200/0x575506951eea1958 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.21@tcp remote: 0xa578910534661fec expref: 60 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830621.741145:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944200/0x575506951eea1958 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661fec expref: 60 pid: 5834 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788830621.741163:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2445d40000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5833:1875724595178112:192.168.201.21@tcp:104: 00000100:00100000:2.0:1788830621.741256:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2551fcb300 going to sleep for 11 seconds 00000100:00100000:2.0:1788830621.743823:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2445d40000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5833:1875724595178112:192.168.201.21@tcp:104: 00010000:00010000:2.0:1788830621.743855:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728a00/0x575506951eea1990 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788830621.744877:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830621.745136:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578415616 00000100:00100000:2.0:1788830621.745147:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578415616 00010000:00010000:2.0:1788830621.745304:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944200/0x575506951eea1958 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661fec expref: 61 pid: 5834 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788830621.745477:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 81 00000100:00100000:2.0:1788830621.745491:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2544ee5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+61:2354:x1875724578415616:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788830621.745514:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788830621.745523:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944200/0x575506951eea1958 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661fec expref: 61 pid: 5834 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830621.745564:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944200/0x575506951eea1958 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661fec expref: 61 pid: 5834 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830621.745597:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944200/0x575506951eea1958 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.21@tcp remote: 0xa578910534661fec expref: 61 pid: 5834 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830621.745619:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e25530b0f00) 00010000:00010000:2.0:1788830621.745625:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728a00/0x575506951eea1990 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830621.745637:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728a00/0x575506951eea1990 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830621.745645:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728a00/0x575506951eea1990 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830621.745694:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788830621.745777:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728a00/0x575506951eea1990 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.745793:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728a00/0x575506951eea1990 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788830621.745819:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000100:00100000:2.0:1788830621.745832:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2544ee5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+60:2354:x1875724578415616:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 342us (965us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830621.745844:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 81 00010000:00010000:0.0:1788830621.746029:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728e00/0x575506951eea1989 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534662001 expref: 61 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.746130:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728a00/0x575506951eea1990 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0xa578910534662001 expref: 60 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.746141:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e25530b0f00) 00010000:00010000:0.0:1788830621.746144:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788830621.746148:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2565728a00, rc 0) 00000100:00100000:0.0:1788830621.746236:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25654d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+60:11616:x1875724578415488:12345-192.168.201.21@tcp:101:lfs.0 Request processed in 5392us (6116us total) trans 4294967500 rc 0/0 00000100:00100000:0.0:1788830621.746245:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 211 00000100:00100000:1.0:1788830621.766635:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830621.766751:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578415872 00000100:00100000:2.0:1788830621.766761:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578415872 00000100:00100000:2.0:1788830621.766867:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 17 00000100:00100000:2.0:1788830621.766880:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257fac9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+60:11616:x1875724578415872:12345-192.168.201.21@tcp:103:lfs.0 00010000:00010000:2.0:1788830621.766898:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788830621.766926:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944800/0x575506951eea18ef lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661fd7 expref: 60 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830621.766964:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e25530b0f00) 00010000:00010000:2.0:1788830621.766970:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788830621.767036:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257fac9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+59:11616:x1875724578415872:12345-192.168.201.21@tcp:103:lfs.0 Request processed in 159us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830621.767043:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 17 00000100:00100000:1.0:1788830621.775118:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830621.775317:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578416000 00000100:00100000:0.0:1788830621.775329:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578416000 00000100:00100000:0.0:1788830621.775404:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 212 00000100:00100000:0.0:1788830621.775415:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25654b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+59:11616:x1875724578416000:12345-192.168.201.21@tcp:58:lfs.0 00010000:00010000:0.0:1788830621.775543:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7600/0x575506951eea199e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.775562:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7600/0x575506951eea199e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.775574:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7600/0x575506951eea199e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788830621.775864:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:0.0:1788830621.776023:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25654b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+59:11616:x1875724578416000:12345-192.168.201.21@tcp:58:lfs.0 Request processed in 608us (914us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830621.776031:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 212 00000100:00100000:1.0:1788830621.780480:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830621.781412:0:8202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578416128 00000100:00100000:3.0:1788830621.781428:0:8202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578416128 00000100:00100000:2.0:1788830621.782240:0:8202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 213 00000100:00100000:2.0:1788830621.782252:0:8202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25654b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+59:11616:x1875724578416128:12345-192.168.201.21@tcp:101:lfs.0 00010000:00010000:2.0:1788830621.782276:0:8202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788830621.782300:0:8202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729a00/0x575506951eea19a5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa578910534662008 expref: -99 pid: 8202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830621.782364:0:8202:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7600/0x575506951eea199e lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830621.782376:0:8202:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729a00/0x575506951eea19a5 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534662008 expref: 60 pid: 8202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830621.782399:0:8202:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7600/0x575506951eea199e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830621.782413:0:8202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729a00/0x575506951eea19a5 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534662008 expref: 60 pid: 8202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830621.782427:0:8202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e25530b0f00) 00010000:00010000:2.0:1788830621.782431:0:8202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788830621.782434:0:8202:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729a00/0x575506951eea19a5 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534662008 expref: 60 pid: 8202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830621.782456:0:8202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2565729a00, rc 0) 00000100:00100000:2.0:1788830621.782532:0:8202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25654b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+60:11616:x1875724578416128:12345-192.168.201.21@tcp:101:lfs.0 Request processed in 281us (2062us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830621.782547:0:8202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 213 00000001:00080000:2.0:1788830621.959905:0:7646:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000001:00080000:2.0:1788830621.959926:0:7646:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000040:00080000:1.0:1788830621.980020:0:11676:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788830621.980030:0:11676:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788830621.980082:0:11676:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:1.0:1788830621.980089:0:11676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788830621.980214:0:11676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25654b2300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11676:1875724595178240:192.168.201.21@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788830621.980375:0:11676:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e25656196c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788830621.993319:0:11676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25654b2300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11676:1875724595178240:192.168.201.21@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788830621.994971:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830621.995065:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578416256 00000100:00100000:2.0:1788830621.995074:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578416256 00000100:00100000:2.0:1788830621.995134:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 214 00000100:00100000:2.0:1788830621.995146:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25654b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+60:11617:x1875724578416256:12345-192.168.201.21@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788830621.995182:0:5834:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788830621.995377:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25654b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+60:11617:x1875724578416256:12345-192.168.201.21@tcp:53:lhsmtool_posix.0 Request processed in 231us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830621.995384:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 214 00000100:00100000:1.0:1788830621.998160:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830621.998275:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578416384 00000100:00100000:0.0:1788830621.998285:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578416384 00000100:00100000:0.0:1788830621.998391:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 215 00000100:00100000:0.0:1788830621.998402:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25654b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+60:11617:x1875724578416384:12345-192.168.201.21@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788830621.998492:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7400/0x575506951eea19ac lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.998509:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7400/0x575506951eea19ac lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.998522:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7400/0x575506951eea19ac lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.998547:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6c00/0x575506951eea19b3 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.998569:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6c00/0x575506951eea19b3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.998577:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6c00/0x575506951eea19b3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.998602:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7a00/0x575506951eea19ba lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.998611:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7a00/0x575506951eea19ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.998618:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7a00/0x575506951eea19ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788830621.998681:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1788830621.998686:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788830621.998700:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7a00/0x575506951eea19ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.998746:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7400/0x575506951eea19ac lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.998752:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7400/0x575506951eea19ac lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.998759:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7400/0x575506951eea19ac lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.998765:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e25658d7400 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:0.0:1788830621.998770:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7400/0x575506951eea19ac lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.998785:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7400/0x575506951eea19ac lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.998798:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e257480cd00) 00010000:00010000:0.0:1788830621.998802:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788830621.998807:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7400/0x575506951eea19ac lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.998813:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7400/0x575506951eea19ac lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.998826:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6c00/0x575506951eea19b3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.998833:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6c00/0x575506951eea19b3 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.998839:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6c00/0x575506951eea19b3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.998843:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e25658d6c00 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:0.0:1788830621.998845:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6c00/0x575506951eea19b3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.998850:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6c00/0x575506951eea19b3 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.998857:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff9e25518dcf00) 00010000:00010000:0.0:1788830621.998859:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788830621.998861:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6c00/0x575506951eea19b3 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.998875:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6c00/0x575506951eea19b3 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.998890:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7a00/0x575506951eea19ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.998896:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7a00/0x575506951eea19ba lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.998902:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7a00/0x575506951eea19ba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.998908:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e25658d7a00 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:0.0:1788830621.998911:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7a00/0x575506951eea19ba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.998917:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7a00/0x575506951eea19ba lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.998925:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e25530b0f00) 00010000:00010000:0.0:1788830621.998927:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788830621.998931:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7a00/0x575506951eea19ba lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830621.998936:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7a00/0x575506951eea19ba lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788830621.998999:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25654b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+60:11617:x1875724578416384:12345-192.168.201.21@tcp:34:lhsmtool_posix.0 Request processed in 597us (846us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830621.999006:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 215 00000100:00100000:1.0:1788830622.005127:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830622.005340:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578416640 00000100:00100000:0.0:1788830622.005351:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578416640 00000100:00100000:0.0:1788830622.005435:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 216 00000100:00100000:0.0:1788830622.005445:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25654b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+60:11617:x1875724578416640:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788830622.005469:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788830622.005491:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7a00/0x575506951eea19c1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa57891053466200f expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830622.005599:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6c00/0x575506951eea19c8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830622.005615:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6c00/0x575506951eea19c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830622.005627:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6c00/0x575506951eea19c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788830622.005648:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000100:00080000:2.0:1788830622.005837:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788830622.006050:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6c00/0x575506951eea19c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830622.006058:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6c00/0x575506951eea19c8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830622.006064:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6c00/0x575506951eea19c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830622.006070:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e25658d6c00 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:0.0:1788830622.006074:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6c00/0x575506951eea19c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830622.006138:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6c00/0x575506951eea19c8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830622.006168:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e25530b0f00) 00010000:00010000:0.0:1788830622.006171:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788830622.006176:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6c00/0x575506951eea19c8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830622.006182:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6c00/0x575506951eea19c8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830622.006227:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7a00/0x575506951eea19c1 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0xa57891053466200f expref: 62 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830622.006238:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e257480cd00) 00010000:00010000:0.0:1788830622.006241:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788830622.006245:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7a00/0x575506951eea19c1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.21@tcp remote: 0xa57891053466200f expref: 62 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830622.006254:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e25658d7a00, rc 0) 00000100:00100000:0.0:1788830622.006783:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25654b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+61:11617:x1875724578416640:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 Request processed in 1337us (1663us total) trans 4294967501 rc 301/301 00000100:00100000:0.0:1788830622.006792:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 216 00000100:00100000:1.0:1788830622.015317:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830622.015486:0:8202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578416768 00000100:00100000:2.0:1788830622.015497:0:8202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578416768 00000100:00100000:2.0:1788830622.015608:0:8202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 217 00000100:00100000:2.0:1788830622.015619:0:8202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25654b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+61:11617:x1875724578416768:12345-192.168.201.21@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788830622.015690:0:8202:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788830622.015827:0:8202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25654b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+61:11617:x1875724578416768:12345-192.168.201.21@tcp:53:lhsmtool_posix.0 Request processed in 210us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830622.015835:0:8202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 217 00000100:00100000:1.0:1788830622.022881:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830622.023068:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578417024 00000100:00100000:3.0:1788830622.023216:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578417024 00000100:00100000:3.0:1788830622.023282:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 218 00000100:00100000:3.0:1788830622.023292:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25654b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+61:11617:x1875724578417024:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788830622.023314:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788830622.023317:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788830622.023344:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945c00/0x575506951eea1966 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661ff3 expref: 61 pid: 8202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830622.023364:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e25530b0b00) 00010000:00010000:3.0:1788830622.023368:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788830622.023382:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944000/0x575506951eea19d6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa578910534662016 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788830622.024575:0:5834:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6:0x0], index 0: 0 00010000:00010000:3.0:1788830622.024885:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944800/0x575506951eea19dd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830622.024902:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944800/0x575506951eea19dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830622.024914:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944800/0x575506951eea19dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830622.024986:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944000/0x575506951eea19d6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534662016 expref: 63 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830622.025007:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944800/0x575506951eea19dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0xa578910534662016 expref: 62 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830622.025031:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9e25530b0000) 00010000:00010000:3.0:1788830622.025034:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788830622.025036:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e257d944800, rc 0) 00000100:00100000:3.0:1788830622.025428:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25654b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+62:11617:x1875724578417024:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 Request processed in 2136us (2555us total) trans 4294967502 rc 0/0 00000100:00100000:3.0:1788830622.025436:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 218 00000100:00100000:1.0:1788830622.031117:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830622.031396:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578417280 00000100:00100000:0.0:1788830622.031406:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578417280 00000100:00100000:0.0:1788830622.031522:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 219 00000100:00100000:0.0:1788830622.031533:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25654b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+62:11617:x1875724578417280:12345-192.168.201.21@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788830622.031600:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788830622.031629:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944800/0x575506951eea19dd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.21@tcp remote: 0xa578910534662016 expref: 62 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830622.031674:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9e25530b0000) 00010000:00010000:0.0:1788830622.031687:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788830622.031763:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6c00/0x575506951eea19eb lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830622.031779:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6c00/0x575506951eea19eb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830622.031790:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6c00/0x575506951eea19eb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830622.031805:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7400/0x575506951eea19f2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xb140c9c8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830622.031813:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7400/0x575506951eea19f2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xb140c9c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830622.031820:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7400/0x575506951eea19f2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xb140c9c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830622.031885:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6c00/0x575506951eea19eb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830622.031892:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6c00/0x575506951eea19eb lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830622.031900:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6c00/0x575506951eea19eb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830622.031905:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e25658d6c00 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:0.0:1788830622.031909:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6c00/0x575506951eea19eb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830622.031926:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6c00/0x575506951eea19eb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830622.031936:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e25530b0b00) 00010000:00010000:0.0:1788830622.031939:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788830622.031943:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6c00/0x575506951eea19eb lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830622.031949:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6c00/0x575506951eea19eb lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830622.031959:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7400/0x575506951eea19f2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xb140c9c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830622.031964:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7400/0x575506951eea19f2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xb140c9c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830622.031969:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7400/0x575506951eea19f2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xb140c9c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830622.031987:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e25658d7400 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:0.0:1788830622.031990:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7400/0x575506951eea19f2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xb140c9c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830622.031996:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7400/0x575506951eea19f2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xb140c9c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830622.032007:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xb140c9c8 (ffff9e25518dcf00) 00010000:00010000:0.0:1788830622.032009:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788830622.032012:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7400/0x575506951eea19f2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xb140c9c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830622.032027:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7400/0x575506951eea19f2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xb140c9c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788830622.032122:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25654b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+61:11617:x1875724578417280:12345-192.168.201.21@tcp:36:lhsmtool_posix.0 Request processed in 590us (1015us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788830622.032130:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 219 00000100:00100000:0.0:1788830622.042398:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830622.042632:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578417408 00000100:00100000:2.0:1788830622.042670:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578417408 00000100:00100000:2.0:1788830622.042756:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 220 00000100:00100000:2.0:1788830622.042764:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257f731880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+61:11617:x1875724578417408:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788830622.042785:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788830622.042805:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729400/0x575506951eea19f9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa57891053466201d expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830622.042836:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729800/0x575506951eea1a00 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830622.042847:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729800/0x575506951eea1a00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830622.042856:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729800/0x575506951eea1a00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830622.042939:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729400/0x575506951eea19f9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0xa57891053466201d expref: 63 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830622.042951:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729800/0x575506951eea1a00 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0xa57891053466201d expref: 62 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830622.042958:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9e2551f3e300) 00010000:00010000:2.0:1788830622.042960:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788830622.042962:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2565729800, rc 0) 00000100:00100000:2.0:1788830622.043023:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257f731880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+62:11617:x1875724578417408:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 Request processed in 260us (638us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830622.043028:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 220 00000100:00100000:3.0:1788830622.045918:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830622.046133:0:8202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578417664 00000100:00100000:2.0:1788830622.046156:0:8202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578417664 00000100:00100000:2.0:1788830622.046221:0:8202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 221 00000100:00100000:2.0:1788830622.046231:0:8202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25654d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+62:11617:x1875724578417664:12345-192.168.201.21@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788830622.046318:0:8202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729000/0x575506951eea1a07 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830622.046332:0:8202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729000/0x575506951eea1a07 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830622.046342:0:8202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729000/0x575506951eea1a07 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788830622.046548:0:8202:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00010000:2.0:1788830622.046633:0:8202:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d0a8e99e reply state 000000004f13a83f transno 4294967503 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729000/0x575506951eea1a07 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788830622.046640:0:8202:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788830622.047093:0:8202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25654d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+64:11617:x1875724578417664:12345-192.168.201.21@tcp:36:lhsmtool_posix.0 Request processed in 861us (1183us total) trans 4294967503 rc 0/0 00000100:00100000:2.0:1788830622.047102:0:8202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 221 00010000:00010000:0.0:1788830622.048520:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729000/0x575506951eea1a07 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830622.048546:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729000/0x575506951eea1a07 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830622.048553:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729000/0x575506951eea1a07 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830622.048560:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2565729000 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:0.0:1788830622.048564:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729000/0x575506951eea1a07 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830622.048572:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729000/0x575506951eea1a07 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830622.048591:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9e2551f3e300) 00010000:00010000:0.0:1788830622.048594:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788830622.048599:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729000/0x575506951eea1a07 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830622.048605:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729000/0x575506951eea1a07 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788830622.053270:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830622.054216:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578417792 00000100:00100000:2.0:1788830622.054231:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578417792 00000100:00100000:2.0:1788830622.054375:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 222 00000100:00100000:2.0:1788830622.054391:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25654d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+63:11617:x1875724578417792:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788830622.054424:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788830622.054446:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729400/0x575506951eea1a0e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa578910534662024 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830622.054514:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729400/0x575506951eea1a0e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534662024 expref: 64 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830622.054564:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729400/0x575506951eea1a0e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534662024 expref: 64 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830622.054588:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9e2551f3e300) 00010000:00010000:2.0:1788830622.054591:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788830622.054595:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2565729400, rc 0) 00000100:00100000:2.0:1788830622.054670:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25654d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+64:11617:x1875724578417792:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 Request processed in 284us (1408us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830622.054678:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 222 00000100:00100000:1.0:1788830622.057113:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830622.057186:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578417920 00000100:00100000:0.0:1788830622.057197:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578417920 00000100:00100000:0.0:1788830622.057278:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 64 00000100:00100000:0.0:1788830622.057290:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257fbd3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+9:2353:x1875724578417920:12345-192.168.201.21@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1788830622.057843:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257fbd3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+10:2353:x1875724578417920:12345-192.168.201.21@tcp:2:lhsmtool_posix.0 Request processed in 554us (738us total) trans 4294967319 rc 0/0 00000100:00100000:0.0:1788830622.057852:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 64 00000100:00080000:1.0:1788830622.058674:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788830622.065251:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830622.065508:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578418176 00000100:00100000:1.0:1788830622.065520:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578418176 00000100:00100000:1.0:1788830622.065650:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 59 00000100:00100000:1.0:1788830622.065673:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257f733100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+64:11617:x1875724578418176:12345-192.168.201.21@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788830622.065991:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257f733100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+65:11617:x1875724578418176:12345-192.168.201.21@tcp:35:lhsmtool_posix.0 Request processed in 320us (748us total) trans 4294967504 rc 0/0 00000100:00100000:1.0:1788830622.065999:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 59 00000100:00100000:3.0:1788830622.070913:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830622.071236:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578418432 00000100:00100000:2.0:1788830622.071247:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578418432 00000100:00100000:2.0:1788830622.071307:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 223 00000100:00100000:2.0:1788830622.071318:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25654d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+65:11617:x1875724578418432:12345-192.168.201.21@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788830622.071430:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25654d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+65:11617:x1875724578418432:12345-192.168.201.21@tcp:57:lhsmtool_posix.0 Request processed in 113us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830622.071437:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 223 00000100:00100000:0.0:1788830622.077133:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830622.077223:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578418560 00000100:00100000:3.0:1788830622.077237:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578418560 00000100:00100000:3.0:1788830622.077300:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 224 00000100:00100000:3.0:1788830622.077311:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257f732d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+65:11617:x1875724578418560:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788830622.077336:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788830622.077370:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944000/0x575506951eea1a15 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa57891053466202b expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830622.077455:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945c00/0x575506951eea1a1c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830622.077470:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945c00/0x575506951eea1a1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830622.077483:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945c00/0x575506951eea1a1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788830622.077518:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788830622.077556:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945c00/0x575506951eea1a1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830622.077584:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944000/0x575506951eea1a15 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0xa57891053466202b expref: 67 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830622.077605:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945c00/0x575506951eea1a1c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0xa57891053466202b expref: 66 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830622.077614:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9e2551f3e300) 00010000:00010000:3.0:1788830622.077617:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788830622.077621:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e257d945c00, rc 0) 00000100:00100000:3.0:1788830622.077765:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257f732d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+66:11617:x1875724578418560:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 Request processed in 455us (642us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830622.077772:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 224 00000100:00100000:1.0:1788830622.085118:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830622.085537:0:12010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578418688 00000100:00100000:3.0:1788830622.085612:0:12010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578418688 00000100:00100000:3.0:1788830622.085770:0:12010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 65 00000100:00100000:3.0:1788830622.085781:0:12010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25654b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+10:2355:x1875724578418688:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788830622.085802:0:12010:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788830622.085824:0:12010:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab0bf965/0x575506951eea1a23 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa578910534662032 expref: -99 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788830622.085854:0:12010:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9f639d, blocks: 0x1 00010000:00010000:3.0:1788830622.085878:0:12010:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=375s v=(0 0) 00010000:00010000:3.0:1788830622.085883:0:12010:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788830622.085892:0:12010:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab0bf965/0x575506951eea1a23 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534662032 expref: 11 pid: 12010 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830622.085930:0:12010:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ab0bf965/0x575506951eea1a23 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534662032 expref: 11 pid: 12010 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830622.085945:0:12010:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e257d944000, rc 0) 00000100:00100000:3.0:1788830622.086001:0:12010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25654b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+11:2355:x1875724578418688:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 Request processed in 223us (901us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830622.086007:0:12010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 65 00000100:00100000:0.0:1788830622.091995:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830622.092117:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578418944 00000100:00100000:2.0:1788830622.092128:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578418944 00000100:00100000:2.0:1788830622.092276:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 225 00000100:00100000:2.0:1788830622.092287:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257f731180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+66:11617:x1875724578418944:12345-192.168.201.21@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788830622.093757:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257f731180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+66:11617:x1875724578418944:12345-192.168.201.21@tcp:57:lhsmtool_posix.0 Request processed in 1463us (1764us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830622.093779:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 225 00000100:00100000:0.0:1788830622.099147:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830622.099362:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578419072 00000100:00100000:2.0:1788830622.099387:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578419072 00000100:00100000:2.0:1788830622.099491:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 66 00000100:00100000:2.0:1788830622.099502:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257f730a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+11:11617:x1875724578419072:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788830622.099522:0:6679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788830622.099542:0:6679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008f236222/0x575506951eea1a2a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa578910534662039 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830622.099577:0:6679:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ab0bf965/0x575506951eea1a23 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534662032 expref: 12 pid: 12010 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830622.099587:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788830622.099592:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788830622.099598:0:6679:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008f236222/0x575506951eea1a2a lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534662039 expref: 12 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830622.099634:0:6679:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ab0bf965/0x575506951eea1a23 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.21@tcp remote: 0xa578910534662032 expref: 12 pid: 12010 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830622.099647:0:6679:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ab0bf965/0x575506951eea1a23 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.21@tcp remote: 0xa578910534662032 expref: 12 pid: 12010 timeout: 475 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788830622.099675:0:6679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2445d40000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6679:1875724595178368:192.168.201.21@tcp:104: 00000100:00100000:2.0:1788830622.099822:0:6679:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2553723000 going to sleep for 11 seconds 00000100:00100000:1.0:1788830622.104479:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830622.104517:0:6679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2445d40000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6679:1875724595178368:192.168.201.21@tcp:104: 00010000:00010000:2.0:1788830622.104556:0:6679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008f236222/0x575506951eea1a2a lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.21@tcp remote: 0xa578910534662039 expref: 12 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788830622.104565:0:11161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578419200 00000100:00100000:3.0:1788830622.104573:0:11161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578419200 00010000:00010000:2.0:1788830622.104597:0:6679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2565728c00, rc 0) 00010000:00010000:3.0:1788830622.104606:0:11161:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ab0bf965/0x575506951eea1a23 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.21@tcp remote: 0xa578910534662032 expref: 13 pid: 12010 timeout: 475 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788830622.104646:0:11161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 82 00000100:00100000:3.0:1788830622.104665:0:11161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25654b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+13:2355:x1875724578419200:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788830622.104681:0:11161:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1788830622.104706:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257f730a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+13:11617:x1875724578419072:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 Request processed in 5206us (5633us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830622.104740:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 66 00010000:00010000:3.0:1788830622.104771:0:11161:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ab0bf965/0x575506951eea1a23 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.21@tcp remote: 0xa578910534662032 expref: 12 pid: 12010 timeout: 475 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830622.104785:0:11161:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ab0bf965/0x575506951eea1a23 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.21@tcp remote: 0xa578910534662032 expref: 12 pid: 12010 timeout: 475 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830622.104809:0:11161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab0bf965/0x575506951eea1a23 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.21@tcp remote: 0xa578910534662032 expref: 12 pid: 12010 timeout: 475 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830622.104835:0:11161:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788830622.104840:0:11161:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788830622.104849:0:11161:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008f236222/0x575506951eea1a2a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.21@tcp remote: 0xa578910534662039 expref: 11 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830622.104859:0:11161:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008f236222/0x575506951eea1a2a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.21@tcp remote: 0xa578910534662039 expref: 11 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830622.104892:0:11161:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000008f236222/0x575506951eea1a2a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.21@tcp remote: 0xa578910534662039 expref: 11 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788830622.104906:0:11161:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25654d7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:11161:1875724595178496:192.168.201.21@tcp:105: 00000100:00100000:3.0:1788830622.104959:0:11161:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2553221a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788830622.112568:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830622.112689:0:11161:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25654d7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:11161:1875724595178496:192.168.201.21@tcp:105: 00010000:00010000:3.0:1788830622.112746:0:11161:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788830622.112759:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578419328 00000100:00100000:2.0:1788830622.112775:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578419328 00000100:00100000:3.0:1788830622.112806:0:11161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25654b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+12:2355:x1875724578419200:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 8151us (8344us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830622.112816:0:11161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 82 00002000:00100000:2.0:1788830622.112828:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff9e257f731f80 x1875724578419328/t0(0) o4->1ef2fe7a-e5ec-4085-8326-b72aa00876cd@192.168.201.21@tcp:73/0 lens 504/0 e 0 to 0 dl 1788830633 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788830622.112837:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e257f731f80 with x1875724578419328 ext(0->12) 00002000:00010000:2.0:1788830622.112842:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e257f731f80 00000100:00100000:2.0:1788830622.112877:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 6 00000100:00100000:2.0:1788830622.112886:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257f731f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+11:2353:x1875724578419328:12345-192.168.201.21@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788830622.113457:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257f731f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+13:2353:x1875724578419328:12345-192.168.201.21@tcp:4:lhsmtool_posix.0 Request processed in 570us (900us total) trans 4294967320 rc 0/0 00000100:00100000:2.0:1788830622.113464:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 6 00002000:00100000:2.0:1788830622.113472:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff9e257f731f80 x1875724578419328/t4294967320(0) o4->1ef2fe7a-e5ec-4085-8326-b72aa00876cd@192.168.201.21@tcp:73/0 lens 504/448 e 0 to 0 dl 1788830633 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788830622.113479:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e257f731f80 with x1875724578419328 ext(0->12) 00002000:00010000:2.0:1788830622.113482:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e257f731f80 00000100:00100000:0.0:1788830622.115827:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830622.116514:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578419456 00000100:00100000:2.0:1788830622.116524:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578419456 00000100:00100000:2.0:1788830622.116601:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 226 00000100:00100000:2.0:1788830622.116610:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257f731500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+66:11617:x1875724578419456:12345-192.168.201.21@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1788830622.157901:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967501 is committed 00000004:00080000:3.0:1788830622.157942:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 10 committed 00000001:00080000:3.0:1788830622.157964:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967504 is committed 00000004:00080000:3.0:1788830622.157971:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000020:00080000:3.0:1788830622.157987:0:5855:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9e2548317840 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:3.0:1788830622.157992:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9e2544fa9100 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9e2548317000 00000020:00080000:3.0:1788830622.158009:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9e2544fa9e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9e2565b7b400 00000020:00080000:3.0:1788830622.158066:0:5855:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9e2565619480 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:3.0:1788830622.158069:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9e2547118b00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9e25656199c0 00000020:00080000:3.0:1788830622.158072:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9e2547118500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9e2565718c00 00000020:00080000:3.0:1788830622.158264:0:5866:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000100:00100000:1.0:1788830622.158700:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257f731500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+20:11617:x1875724578419456:12345-192.168.201.21@tcp:44:lhsmtool_posix.0 Request processed in 42083us (42877us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830622.158728:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 226 00000020:00080000:3.0:1788830622.159617:0:5866:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:3.0:1788830622.159644:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25654d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875724595178624:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788830622.159731:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830622.159801:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788830622.159809:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25654d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875724595178752:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788830622.159833:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830622.160105:0:12010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595178624 00000100:00100000:0.0:1788830622.160114:0:12010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595178624 00000100:00100000:0.0:1788830622.160185:0:12010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595178752 00000100:00100000:0.0:1788830622.160189:0:12010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595178752 00000100:00100000:0.0:1788830622.160214:0:12010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788830622.160225:0:12010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25654d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3309:x1875724595178624:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788830622.160259:0:12010:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00010000:00010000:0.0:1788830622.160286:0:12010:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6226e66/0x575506951eea1a31 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830622.160308:0:12010:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000096b3d79/0x575506951eea17f3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.21@tcp remote: 0xa578910534661f98 expref: 12 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830622.160335:0:12010:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1788830622.160339:0:12010:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788830622.160414:0:12010:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6226e66/0x575506951eea1a31 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830622.160452:0:12010:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000096b3d79/0x575506951eea17f3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.21@tcp remote: 0xa578910534661f98 expref: 12 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830622.160467:0:12010:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000096b3d79/0x575506951eea17f3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.21@tcp remote: 0xa578910534661f98 expref: 12 pid: 6680 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788830622.160480:0:12010:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25658e3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:12010:1875724595178880:192.168.201.21@tcp:104: 00000100:00100000:1.0:1788830622.160634:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788830622.160644:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25654d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875724595178752:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788830622.160671:0:6677:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00002000:00010000:1.0:1788830622.160699:0:6677:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a9f639c, atime: 0x6a9f639d, ctime: 0x6a9f639c, blocks: 0xb 00010000:00010000:1.0:1788830622.160704:0:6677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a38be166/0x575506951eea1a38 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830622.160738:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=375s v=(0 0) 00010000:00010000:1.0:1788830622.160741:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788830622.160746:0:6677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a38be166/0x575506951eea1a38 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830622.160773:0:6677:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a38be166/0x575506951eea1a38 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830622.160783:0:6677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a38be166/0x575506951eea1a38 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830622.160789:0:6677:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a38be166/0x575506951eea1a38 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830622.160806:0:6677:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788830622.161474:0:12010:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2548034b40 going to sleep for 11 seconds 00000100:00080000:2.0:1788830622.162140:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788830622.162287:0:3309:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:3.0:1788830622.162295:0:3309:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e256549aa00, transno 4294967307 00000004:00080000:3.0:1788830622.162315:0:3309:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967309 00000100:00100000:3.0:1788830622.162336:0:3309:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9e25654d4380 x1875724595178752/t4294967310(4294967310) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788830638 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1788830622.162408:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e25654d4380/2, rc 0, transno 4294967310 00000100:00100000:3.0:1788830622.162415:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25654d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875724595178752:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788830622.162849:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25654d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3309:x1875724595178752:12345-0@lo:6:osp-syn-1-0.0 Request processed in 703us (1511us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1788830622.162859:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00010000:00010000:1.0:1788830622.162895:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788830622.162904:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a38be166/0x575506951eea1a38 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830622.162916:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e257fa8da00 already unused, calling callback (ffffffffc14cb350) 00010000:00010000:1.0:1788830622.162921:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a38be166/0x575506951eea1a38 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830622.162932:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a38be166/0x575506951eea1a38 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830622.162955:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a38be166/0x575506951eea1a38 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830622.162970:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a38be166/0x575506951eea1a38 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830622.162992:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788830622.162994:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788830622.162995:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788830622.165819:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830622.165893:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578419584 00000100:00100000:2.0:1788830622.165902:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578419584 00010000:00010000:2.0:1788830622.165941:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000096b3d79/0x575506951eea17f3 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.21@tcp remote: 0xa578910534661f98 expref: 13 pid: 6680 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788830622.165983:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 83 00000100:00100000:2.0:1788830622.165993:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255005f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+13:2354:x1875724578419584:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788830622.166008:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788830622.166013:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000096b3d79/0x575506951eea17f3 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.21@tcp remote: 0xa578910534661f98 expref: 13 pid: 6680 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830622.166026:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000096b3d79/0x575506951eea17f3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.21@tcp remote: 0xa578910534661f98 expref: 13 pid: 6680 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830622.166052:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788830622.166056:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788830622.166061:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a6226e66/0x575506951eea1a31 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830622.166070:0:5819:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6226e66/0x575506951eea1a31 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830622.166091:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788830622.166145:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255005f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+13:2354:x1875724578419584:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 153us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830622.166167:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 83 00010000:00010000:3.0:1788830622.167066:0:12010:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000096b3d79/0x575506951eea17f3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.21@tcp remote: 0xa578910534661f98 expref: 12 pid: 6680 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788830622.167086:0:12010:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25658e3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:12010:1875724595178880:192.168.201.21@tcp:104: 00010000:00010000:3.0:1788830622.167113:0:12010:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a6226e66/0x575506951eea1a31 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830622.167141:0:12010:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a6226e66/0x575506951eea1a31 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830622.167148:0:12010:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6226e66/0x575506951eea1a31 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830622.167157:0:12010:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6226e66/0x575506951eea1a31 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830622.167165:0:12010:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a6226e66/0x575506951eea1a31 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830622.167189:0:12010:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788830622.167427:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788830622.167435:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a6226e66/0x575506951eea1a31 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830622.167443:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e25658d6200 already unused, calling callback (ffffffffc14cb350) 00010000:00010000:1.0:1788830622.167448:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6226e66/0x575506951eea1a31 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830622.167458:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6226e66/0x575506951eea1a31 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830622.167476:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a6226e66/0x575506951eea1a31 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830622.167483:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6226e66/0x575506951eea1a31 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830622.167502:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788830622.167504:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788830622.167505:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788830622.168081:0:12010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25654d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3309:x1875724595178624:12345-0@lo:6:osp-syn-0-0.0 Request processed in 7856us (8347us total) trans 4294967321 rc 0/0 00000100:00100000:3.0:1788830622.168094:0:12010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000004:00080000:0.0:1788830622.168928:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e25654d7100/2, rc 0, transno 4294967321 00000100:00100000:0.0:1788830622.168947:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25654d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875724595178624:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788830622.170963:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830622.171046:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578419712 00000100:00100000:2.0:1788830622.171057:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578419712 00000100:00100000:2.0:1788830622.171112:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 69 00000100:00100000:2.0:1788830622.171122:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255005ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+12:2354:x1875724578419712:12345-192.168.201.21@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1788830622.208559:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255005ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+12:2354:x1875724578419712:12345-192.168.201.21@tcp:16:lhsmtool_posix.0 Request processed in 37424us (37591us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830622.208575:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 69 00000001:00080000:1.0:1788830622.209280:0:6709:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967319 is committed 00000001:00080000:1.0:1788830622.209292:0:6709:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967317 is committed 00000001:00080000:1.0:1788830622.209304:0:6709:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967320 is committed 00000001:00080000:1.0:1788830622.209316:0:6709:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967321 is committed 00000100:00100000:1.0:1788830622.211592:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830622.211705:0:8202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578419968 00000100:00100000:3.0:1788830622.211803:0:8202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578419968 00000100:00100000:0.0:1788830622.211981:0:8202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 227 00000100:00100000:0.0:1788830622.211992:0:8202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25654b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+20:11617:x1875724578419968:12345-192.168.201.21@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788830622.212052:0:8202:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788830622.212119:0:8202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945c00/0x575506951eea1a1c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.21@tcp remote: 0xa57891053466202b expref: 20 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830622.212141:0:8202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9e2551f3e300) 00010000:00010000:0.0:1788830622.212146:0:8202:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788830622.212181:0:8202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7c00/0x575506951eea1a3f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830622.212196:0:8202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7c00/0x575506951eea1a3f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830622.212208:0:8202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7c00/0x575506951eea1a3f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788830622.212559:0:8202:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008f425d3c reply state 000000001170bd9e transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7c00/0x575506951eea1a3f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788830622.212570:0:8202:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788830622.212803:0:8202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25654b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+21:11617:x1875724578419968:12345-192.168.201.21@tcp:36:lhsmtool_posix.0 Request processed in 811us (1273us total) trans 4294967505 rc 0/0 00000100:00100000:0.0:1788830622.212810:0:8202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 227 00000100:00100000:0.0:1788830622.216928:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830622.217142:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578420096 00000100:00100000:1.0:1788830622.217152:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578420096 00000100:00100000:1.0:1788830622.217209:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 70 00000100:00100000:1.0:1788830622.217219:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25654d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+7:2355:x1875724578420096:12345-192.168.201.21@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788830622.217627:0:6677:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1788830622.217632:0:6677:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1788830621 00002000:00010000:1.0:1788830622.217634:0:6677:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 1788830621 00002000:00010000:1.0:1788830622.217636:0:6677:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1788830621 -> 1788830621 00002000:00010000:1.0:1788830622.217638:0:6677:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1788830622.217743:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25654d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+8:2355:x1875724578420096:12345-192.168.201.21@tcp:2:lhsmtool_posix.0 Request processed in 525us (825us total) trans 4294967322 rc 0/0 00000100:00100000:1.0:1788830622.217751:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 70 00010000:00010000:2.0:1788830622.218009:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7c00/0x575506951eea1a3f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830622.218019:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7c00/0x575506951eea1a3f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830622.218026:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7c00/0x575506951eea1a3f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830622.218032:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e25658d7c00 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:2.0:1788830622.218037:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7c00/0x575506951eea1a3f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830622.218044:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7c00/0x575506951eea1a3f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830622.218061:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9e2551f3e300) 00010000:00010000:2.0:1788830622.218064:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788830622.218069:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7c00/0x575506951eea1a3f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830622.218074:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7c00/0x575506951eea1a3f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788830622.221132:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830622.221207:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578420352 00000100:00100000:3.0:1788830622.221217:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578420352 00000100:00100000:3.0:1788830622.221277:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 228 00000100:00100000:3.0:1788830622.221287:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25654b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+20:11617:x1875724578420352:12345-192.168.201.21@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788830622.221375:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944000/0x575506951eea1a46 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830622.221392:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729800/0x575506951eea1a00 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0xa57891053466201d expref: 20 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830622.221415:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944000/0x575506951eea1a46 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830622.221454:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729800/0x575506951eea1a00 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.21@tcp remote: 0xa57891053466201d expref: 20 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830622.221470:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729800/0x575506951eea1a00 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.21@tcp remote: 0xa57891053466201d expref: 20 pid: 5832 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788830622.221488:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25654d4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5834:1875724595179008:192.168.201.21@tcp:104: 00000100:00100000:3.0:1788830622.221816:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2553221600 going to sleep for 11 seconds 00000100:00100000:1.0:1788830622.225024:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830622.225112:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578420480 00000100:00100000:2.0:1788830622.225136:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578420480 00010000:00010000:2.0:1788830622.225176:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729800/0x575506951eea1a00 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.21@tcp remote: 0xa57891053466201d expref: 21 pid: 5832 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788830622.225224:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 84 00000100:00100000:2.0:1788830622.225234:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25654b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+21:2355:x1875724578420480:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788830622.225249:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788830622.225256:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729800/0x575506951eea1a00 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.21@tcp remote: 0xa57891053466201d expref: 21 pid: 5832 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830622.225269:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729800/0x575506951eea1a00 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.21@tcp remote: 0xa57891053466201d expref: 21 pid: 5832 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830622.225304:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9e2551f3e300) 00010000:00010000:2.0:1788830622.225311:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944000/0x575506951eea1a46 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830622.225321:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944000/0x575506951eea1a46 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830622.225328:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944000/0x575506951eea1a46 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830622.225347:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788830622.225411:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25654b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+21:2355:x1875724578420480:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 178us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830622.225418:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 84 00010000:00010000:3.0:1788830622.226156:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729800/0x575506951eea1a00 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.21@tcp remote: 0xa57891053466201d expref: 20 pid: 5832 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788830622.226176:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25654d4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5834:1875724595179008:192.168.201.21@tcp:104: 00010000:00010000:3.0:1788830622.226197:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944000/0x575506951eea1a46 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830622.226206:0:5834:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944000/0x575506951eea1a46 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830622.226212:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944000/0x575506951eea1a46 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830622.226241:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944000/0x575506951eea1a46 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830622.226248:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944000/0x575506951eea1a46 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830622.226266:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944000/0x575506951eea1a46 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830622.226272:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e257d944000 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:3.0:1788830622.226276:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944000/0x575506951eea1a46 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830622.226284:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944000/0x575506951eea1a46 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830622.226310:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9e2551f3e300) 00010000:00010000:3.0:1788830622.226314:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1788830622.226318:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944000/0x575506951eea1a46 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830622.226324:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944000/0x575506951eea1a46 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788830622.226505:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25654b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+19:11617:x1875724578420352:12345-192.168.201.21@tcp:55:lhsmtool_posix.0 Request processed in 5219us (5382us total) trans 0 rc -22/-22 00000100:00100000:3.0:1788830622.226515:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 228 00000100:00100000:1.0:1788830622.233883:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830622.233975:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578420608 00000100:00100000:3.0:1788830622.233986:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578420608 00000100:00100000:3.0:1788830622.234050:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 71 00000100:00100000:3.0:1788830622.234061:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25654b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+8:2354:x1875724578420608:12345-192.168.201.21@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788830622.234117:0:6680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ab0bf965/0x575506951eea1a4d lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830622.234141:0:6680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008f236222/0x575506951eea1a2a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.21@tcp remote: 0xa578910534662039 expref: 8 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830622.234164:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788830622.234170:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788830622.234174:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab0bf965/0x575506951eea1a4d lrc: 4/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830622.234212:0:6680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008f236222/0x575506951eea1a2a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.21@tcp remote: 0xa578910534662039 expref: 8 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830622.234227:0:6680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008f236222/0x575506951eea1a2a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.21@tcp remote: 0xa578910534662039 expref: 8 pid: 6679 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788830622.234241:0:6680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25654d4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6680:1875724595179136:192.168.201.21@tcp:104: 00000100:00100000:3.0:1788830622.234359:0:6680:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2553221600 going to sleep for 11 seconds 00000100:00100000:0.0:1788830622.238050:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830622.238177:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578420736 00000100:00100000:2.0:1788830622.238186:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578420736 00010000:00010000:2.0:1788830622.238243:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008f236222/0x575506951eea1a2a lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.21@tcp remote: 0xa578910534662039 expref: 9 pid: 6679 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788830622.238300:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 85 00000100:00100000:2.0:1788830622.238311:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25654d1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+9:2355:x1875724578420736:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788830622.238332:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788830622.238367:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008f236222/0x575506951eea1a2a lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.21@tcp remote: 0xa578910534662039 expref: 9 pid: 6679 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830622.238381:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008f236222/0x575506951eea1a2a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.21@tcp remote: 0xa578910534662039 expref: 9 pid: 6679 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830622.238408:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788830622.238413:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788830622.238418:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ab0bf965/0x575506951eea1a4d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830622.238430:0:5819:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab0bf965/0x575506951eea1a4d lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830622.238451:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788830622.238498:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25654d1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+9:2355:x1875724578420736:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 189us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830622.238505:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 85 00010000:00010000:3.0:1788830622.238972:0:6680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008f236222/0x575506951eea1a2a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.21@tcp remote: 0xa578910534662039 expref: 8 pid: 6679 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788830622.238989:0:6680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25654d4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6680:1875724595179136:192.168.201.21@tcp:104: 00010000:00010000:3.0:1788830622.239008:0:6680:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ab0bf965/0x575506951eea1a4d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830622.239018:0:6680:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ab0bf965/0x575506951eea1a4d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830622.239025:0:6680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab0bf965/0x575506951eea1a4d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830622.239062:0:6680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ab0bf965/0x575506951eea1a4d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830622.239071:0:6680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ab0bf965/0x575506951eea1a4d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830622.239079:0:6680:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ab0bf965/0x575506951eea1a4d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830622.239087:0:6680:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e257d944000 already unused, calling callback (ffffffffc14cb350) 00010000:00010000:3.0:1788830622.239091:0:6680:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab0bf965/0x575506951eea1a4d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830622.239100:0:6680:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab0bf965/0x575506951eea1a4d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830622.239113:0:6680:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ab0bf965/0x575506951eea1a4d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830622.239121:0:6680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab0bf965/0x575506951eea1a4d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788830622.239184:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25654b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+7:2354:x1875724578420608:12345-192.168.201.21@tcp:1:lhsmtool_posix.0 Request processed in 5125us (5316us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830622.239192:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 71 00000100:00100000:0.0:1788830622.245792:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830622.245927:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578420992 00000100:00100000:2.0:1788830622.245937:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578420992 00000100:00100000:2.0:1788830622.245996:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 229 00000100:00100000:2.0:1788830622.246020:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2566013100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+19:11617:x1875724578420992:12345-192.168.201.21@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788830622.246125:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728c00/0x575506951eea1a54 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830622.246146:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728c00/0x575506951eea1a54 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830622.246161:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728c00/0x575506951eea1a54 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830622.246412:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729800/0x575506951eea1a5b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830622.246423:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729400/0x575506951eea1a0e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534662024 expref: 20 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830622.246432:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729800/0x575506951eea1a5b lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830622.246467:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729400/0x575506951eea1a0e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.21@tcp remote: 0xa578910534662024 expref: 20 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830622.246482:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729400/0x575506951eea1a0e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.21@tcp remote: 0xa578910534662024 expref: 20 pid: 5832 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788830622.246497:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2445d40000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5833:1875724595179264:192.168.201.21@tcp:104: 00000100:00100000:2.0:1788830622.246830:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2551fcbc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788830622.250552:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830622.250643:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578421120 00000100:00100000:3.0:1788830622.250662:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578421120 00010000:00010000:3.0:1788830622.250704:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729400/0x575506951eea1a0e lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.21@tcp remote: 0xa578910534662024 expref: 21 pid: 5832 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788830622.250769:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 86 00000100:00100000:3.0:1788830622.250779:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255da6a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+21:2354:x1875724578421120:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788830622.250795:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788830622.250803:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729400/0x575506951eea1a0e lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.21@tcp remote: 0xa578910534662024 expref: 21 pid: 5832 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830622.250816:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729400/0x575506951eea1a0e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.21@tcp remote: 0xa578910534662024 expref: 21 pid: 5832 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830622.250840:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9e2551f3e300) 00010000:00010000:3.0:1788830622.250845:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729800/0x575506951eea1a5b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830622.250857:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729800/0x575506951eea1a5b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830622.250864:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729800/0x575506951eea1a5b lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830622.250883:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788830622.250944:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255da6a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+21:2354:x1875724578421120:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 166us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830622.250950:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 86 00010000:00010000:2.0:1788830622.251905:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729400/0x575506951eea1a0e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.21@tcp remote: 0xa578910534662024 expref: 20 pid: 5832 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788830622.251943:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2445d40000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5833:1875724595179264:192.168.201.21@tcp:104: 00010000:00010000:2.0:1788830622.251963:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729800/0x575506951eea1a5b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830622.251970:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729800/0x575506951eea1a5b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830622.251975:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729800/0x575506951eea1a5b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788830622.252160:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967506 00000001:00080000:2.0:1788830622.252330:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967507 00000001:00080000:2.0:1788830622.252388:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000100:00100000:2.0:1788830622.252472:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2445d40000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5833:1875724595179392:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788830622.252524:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788830622.252616:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e25461a5b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788830622.254225:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595179392 00000100:00100000:1.0:1788830622.254241:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595179392 00000100:00100000:1.0:1788830622.254508:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788830622.254522:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2445d43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5833:x1875724595179392:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788830622.254673:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2445d43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5833:x1875724595179392:12345-0@lo:1000:mdt00_001.0 Request processed in 154us (2148us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830622.254700:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788830622.254799:0:5833:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967321 gen 2 00000004:00080000:0.0:1788830622.254805:0:5833:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967321 00000004:00080000:0.0:1788830622.254827:0:5833:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e25654d7100, transno 4294967321 00000100:00100000:0.0:1788830622.254851:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2445d40000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5833:1875724595179392:0@lo:1000:mdt00_001.0 00000001:00080000:0.0:1788830622.255387:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000100:00100000:0.0:1788830622.255475:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2545cbe680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5833:1875724595179520:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788830622.255522:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830622.256353:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2551fcbc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788830622.256510:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595179520 00000100:00100000:2.0:1788830622.256518:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595179520 00000100:00100000:2.0:1788830622.256617:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788830622.256626:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2545cbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5833:x1875724595179520:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788830622.256965:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2545cbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5833:x1875724595179520:12345-0@lo:1000:mdt00_001.0 Request processed in 338us (1441us total) trans 4294967323 rc 0/0 00000100:00100000:2.0:1788830622.256972:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788830622.257059:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2545cbe680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5833:1875724595179520:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1788830622.257098:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729800/0x575506951eea1a5b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830622.257107:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729800/0x575506951eea1a5b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830622.257115:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729800/0x575506951eea1a5b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830622.257120:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2565729800 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:0.0:1788830622.257124:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729800/0x575506951eea1a5b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830622.257132:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729800/0x575506951eea1a5b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830622.257149:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9e2551f3e300) 00010000:00010000:0.0:1788830622.257152:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788830622.257157:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729800/0x575506951eea1a5b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830622.257162:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729800/0x575506951eea1a5b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830622.257191:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7600/0x575506951eea199e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830622.257198:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7600/0x575506951eea199e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830622.257214:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7600/0x575506951eea199e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830622.257218:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e25658d7600 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:0.0:1788830622.257221:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7600/0x575506951eea199e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830622.257226:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7600/0x575506951eea199e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830622.257234:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e25530b0f00) 00010000:00010000:0.0:1788830622.257236:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788830622.257243:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729a00/0x575506951eea19a5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534662008 expref: 23 pid: 8202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830622.257253:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729a00/0x575506951eea19a5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.21@tcp remote: 0xa578910534662008 expref: 23 pid: 8202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830622.257261:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729a00/0x575506951eea19a5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.21@tcp remote: 0xa578910534662008 expref: 23 pid: 8202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830622.257592:0:5833:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729a00/0x575506951eea19a5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534662008 expref: 23 pid: 8202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788830622.257612:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e244599bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5833:1875724595179648:192.168.201.21@tcp:105: 00000100:00100000:0.0:1788830622.257702:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2551fcbc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788830622.261141:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e244599bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5833:1875724595179648:192.168.201.21@tcp:105: 00010000:00010000:2.0:1788830622.261176:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7600/0x575506951eea199e lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830622.261205:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7600/0x575506951eea199e lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830622.261240:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729600/0x575506951eea1a62 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830622.261254:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729600/0x575506951eea1a62 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830622.261266:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729600/0x575506951eea1a62 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830622.261276:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729600/0x575506951eea1a62 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830622.261282:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729600/0x575506951eea1a62 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830622.261288:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729600/0x575506951eea1a62 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830622.261293:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2565729600 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:2.0:1788830622.261297:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729600/0x575506951eea1a62 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830622.261304:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729600/0x575506951eea1a62 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830622.261314:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e25530b0f00) 00010000:00010000:2.0:1788830622.261317:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788830622.261320:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729600/0x575506951eea1a62 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830622.261333:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729600/0x575506951eea1a62 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830622.261344:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728c00/0x575506951eea1a54 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830622.261349:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728c00/0x575506951eea1a54 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830622.261354:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728c00/0x575506951eea1a54 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830622.261359:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2565728c00 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:2.0:1788830622.261362:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728c00/0x575506951eea1a54 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830622.261367:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728c00/0x575506951eea1a54 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830622.261375:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e25530b0f00) 00010000:00010000:2.0:1788830622.261377:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788830622.261379:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728c00/0x575506951eea1a54 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830622.261385:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728c00/0x575506951eea1a54 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788830622.261523:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830622.261811:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578421248 00000100:00100000:1.0:1788830622.261819:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578421248 00000100:00100000:1.0:1788830622.261871:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 60 00000100:00100000:1.0:1788830622.261880:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25654b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+24:11616:x1875724578421248:12345-192.168.201.21@tcp:49:lfs.0 00000100:00100000:1.0:1788830622.262013:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25654b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+24:11616:x1875724578421248:12345-192.168.201.21@tcp:49:lfs.0 Request processed in 133us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830622.262021:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 60 00000100:00100000:2.0:1788830622.262233:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2566013100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+23:11617:x1875724578420992:12345-192.168.201.21@tcp:57:lhsmtool_posix.0 Request processed in 16214us (16452us total) trans 4294967510 rc 0/0 00000100:00100000:2.0:1788830622.262244:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 229 00000020:00080000:2.0:1788830622.262258:0:5833:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1788830622.262473:0:11676:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788830622.262478:0:11676:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788830622.263026:0:11676:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1788830622.263034:0:11676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788830622.264697:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830622.266199:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578421504 00000100:00100000:3.0:1788830622.266235:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578421504 00000100:00100000:3.0:1788830622.266319:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 230 00000100:00100000:3.0:1788830622.266330:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25654b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+23:11616:x1875724578421504:12345-192.168.201.21@tcp:58:lfs.0 00000040:00080000:3.0:1788830622.266785:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:3.0:1788830622.267964:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25654b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+23:11616:x1875724578421504:12345-192.168.201.21@tcp:58:lfs.0 Request processed in 1628us (3268us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830622.267978:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 230 00000100:00100000:2.0:1788830622.273104:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830622.273307:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578421760 00000100:00100000:3.0:1788830622.273320:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578421760 00000100:00100000:3.0:1788830622.273567:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 61 00000100:00100000:3.0:1788830622.273578:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25629b0050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+23:11617:x1875724578421760:12345-192.168.201.21@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788830622.274686:0:5835:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788830622.274834:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00010000:00010000:3.0:1788830622.274888:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944000/0x575506951eea1a69 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830622.274905:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944000/0x575506951eea1a69 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830622.274918:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944000/0x575506951eea1a69 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830622.274926:0:5835:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944000/0x575506951eea1a69 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830622.274932:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944000/0x575506951eea1a69 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830622.274938:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944000/0x575506951eea1a69 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830622.275049:0:5835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788830622.275158:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25629b0050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+25:11617:x1875724578421760:12345-192.168.201.21@tcp:35:lhsmtool_posix.0 Request processed in 1578us (2062us total) trans 4294967512 rc 0/0 00000100:00100000:3.0:1788830622.275168:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 61 00000020:00080000:3.0:1788830622.275174:0:5835:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788830622.277540:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788830622.277554:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944000/0x575506951eea1a69 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830622.277565:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e257d944000 already unused, calling callback (ffffffffc14cb350) 00010000:00010000:1.0:1788830622.277570:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944000/0x575506951eea1a69 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830622.277580:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944000/0x575506951eea1a69 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830622.277601:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9e25530b0c00) 00010000:00010000:1.0:1788830622.277604:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788830622.277609:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944000/0x575506951eea1a69 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830622.277615:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944000/0x575506951eea1a69 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830622.277745:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788830622.277748:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788830622.277750:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788830622.304262:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830622.304635:0:8202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578421888 00000100:00100000:0.0:1788830622.304661:0:8202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578421888 00000100:00100000:0.0:1788830622.304762:0:8202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 231 00000100:00100000:0.0:1788830622.304775:0:8202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25654b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+25:11619:x1875724578421888:12345-192.168.201.21@tcp:101:lfs.0 00010000:00010000:0.0:1788830622.304803:0:8202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788830622.304827:0:8202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7e00/0x575506951eea1a70 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa578910534662040 expref: -99 pid: 8202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830622.304899:0:8202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6600/0x575506951eea1a77 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830622.304915:0:8202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6600/0x575506951eea1a77 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830622.304927:0:8202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6600/0x575506951eea1a77 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830622.304942:0:8202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6400/0x575506951eea1a7e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830622.304950:0:8202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6400/0x575506951eea1a7e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830622.304957:0:8202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6400/0x575506951eea1a7e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830622.305220:0:8202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6800/0x575506951eea1a85 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830622.305237:0:8202:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728a00/0x575506951eea1990 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0xa578910534662001 expref: 26 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830622.305245:0:8202:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6800/0x575506951eea1a85 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830622.305276:0:8202:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728a00/0x575506951eea1990 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.21@tcp remote: 0xa578910534662001 expref: 26 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830622.305292:0:8202:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728a00/0x575506951eea1990 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.21@tcp remote: 0xa578910534662001 expref: 26 pid: 5833 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788830622.305307:0:8202:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e244599b800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8202:1875724595179776:192.168.201.21@tcp:104: 00000100:00100000:0.0:1788830622.305403:0:8202:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2551fcb780 going to sleep for 11 seconds 00000100:00100000:0.0:1788830622.310698:0:8202:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e244599b800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8202:1875724595179776:192.168.201.21@tcp:104: 00010000:00010000:0.0:1788830622.310776:0:8202:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6800/0x575506951eea1a85 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788830622.311861:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830622.312027:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578422144 00000100:00100000:2.0:1788830622.312039:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578422144 00000100:00100000:2.0:1788830622.312148:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 62 00000100:00100000:2.0:1788830622.312161:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25654b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+27:5589:x1875724578422144:12345-192.168.201.21@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788830622.312420:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25654b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+28:5589:x1875724578422144:12345-192.168.201.21@tcp:35:ldlm_bl.0 Request processed in 261us (562us total) trans 4294967513 rc 0/0 00000100:00100000:2.0:1788830622.312429:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 62 00000100:00100000:2.0:1788830622.314568:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830622.314649:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578422272 00000100:00100000:1.0:1788830622.314668:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578422272 00010000:00010000:1.0:1788830622.314818:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728a00/0x575506951eea1990 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.21@tcp remote: 0xa578910534662001 expref: 28 pid: 5833 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788830622.314941:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 87 00000100:00100000:0.0:1788830622.314954:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2445d42a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+28:2355:x1875724578422272:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788830622.314970:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788830622.314978:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728a00/0x575506951eea1990 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.21@tcp remote: 0xa578910534662001 expref: 28 pid: 5833 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830622.314991:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728a00/0x575506951eea1990 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.21@tcp remote: 0xa578910534662001 expref: 28 pid: 5833 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830622.315035:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728a00/0x575506951eea1990 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.21@tcp remote: 0xa578910534662001 expref: 28 pid: 5833 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830622.315051:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e25530b0f00) 00010000:00010000:0.0:1788830622.315058:0:5817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6800/0x575506951eea1a85 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830622.315069:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6800/0x575506951eea1a85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830622.315076:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6800/0x575506951eea1a85 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830622.315110:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788830622.315204:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2445d42a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+27:2355:x1875724578422272:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 251us (644us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830622.315212:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 87 00010000:00010000:2.0:1788830622.315421:0:8202:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6800/0x575506951eea1a85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830622.315431:0:8202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6800/0x575506951eea1a85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788830622.315479:0:8202:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1788830622.315485:0:8202:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788830622.315506:0:8202:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6800/0x575506951eea1a85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830622.315519:0:8202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6800/0x575506951eea1a85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830622.315528:0:8202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6600/0x575506951eea1a77 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830622.315534:0:8202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6600/0x575506951eea1a77 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830622.315541:0:8202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6600/0x575506951eea1a77 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830622.315553:0:8202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e25658d6600 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:2.0:1788830622.315558:0:8202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6600/0x575506951eea1a77 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830622.315567:0:8202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6600/0x575506951eea1a77 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830622.315577:0:8202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e25530b0b00) 00010000:00010000:2.0:1788830622.315580:0:8202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788830622.315584:0:8202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6600/0x575506951eea1a77 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830622.315666:0:8202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6600/0x575506951eea1a77 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830622.315679:0:8202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6400/0x575506951eea1a7e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830622.315685:0:8202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6400/0x575506951eea1a7e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830622.315691:0:8202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6400/0x575506951eea1a7e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830622.315696:0:8202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e25658d6400 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:2.0:1788830622.315699:0:8202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6400/0x575506951eea1a7e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830622.315704:0:8202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6400/0x575506951eea1a7e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830622.315762:0:8202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9e25518dcb00) 00010000:00010000:2.0:1788830622.315764:0:8202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788830622.315768:0:8202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6400/0x575506951eea1a7e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830622.315774:0:8202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6400/0x575506951eea1a7e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830622.315809:0:8202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7e00/0x575506951eea1a70 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534662040 expref: 27 pid: 8202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830622.315825:0:8202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6800/0x575506951eea1a85 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0xa578910534662040 expref: 26 pid: 8202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830622.316055:0:8202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e25530b0f00) 00010000:00010000:2.0:1788830622.316059:0:8202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788830622.316061:0:8202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e25658d6800, rc 0) 00000100:00100000:2.0:1788830622.316103:0:8202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25654b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+26:11619:x1875724578421888:12345-192.168.201.21@tcp:101:lfs.0 Request processed in 11331us (11852us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830622.316111:0:8202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 231 00000100:00100000:2.0:1788830622.428985:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25654b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875724595179904:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788830622.429056:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830622.429231:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595179904 00000100:00100000:0.0:1788830622.429239:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595179904 00000100:00100000:0.0:1788830622.429289:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788830622.429299:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2445d40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1875724595179904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788830622.429322:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3856662528 00000004:00080000:1.0:1788830622.432067:0:6697:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 375779354611ns, next at 376779351886ns, rc = 0 00000100:00100000:0.0:1788830622.433077:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2445d40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1875724595179904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3770us (4011us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830622.433090:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788830622.436431:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25654b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875724595179904:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788830622.747892:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788830623.116186:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830623.116233:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830623.116271:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830623.116296:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578422528 00000100:00100000:0.0:1788830623.116306:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578422528 00000100:00100000:0.0:1788830623.116366:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 89 00000100:00100000:0.0:1788830623.116378:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e244599b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+5:2355:x1875724578422528:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:0.0:1788830623.116451:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e244599b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+5:2355:x1875724578422528:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 75us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830623.116458:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 89 00000100:00100000:0.0:1788830623.116482:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578422656 00000100:00100000:0.0:1788830623.116485:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578422656 00000100:00100000:0.0:1788830623.116516:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 141 00000100:00100000:0.0:1788830623.116523:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e244599bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2154ea6-69cb-4a30-aac0-000fba13e98b+5:2355:x1875724578422656:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:0.0:1788830623.116550:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e244599bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2154ea6-69cb-4a30-aac0-000fba13e98b+5:2355:x1875724578422656:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 27us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830623.116555:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 141 00000100:00080000:0.0:1788830623.116569:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788830623.116572:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788830623.116829:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578422400 00000100:00100000:3.0:1788830623.116904:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578422400 00000100:00100000:3.0:1788830623.116937:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 293 00000100:00100000:3.0:1788830623.116943:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255d948850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+13:2355:x1875724578422400:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:3.0:1788830623.116975:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255d948850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+13:2355:x1875724578422400:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 32us (799us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830623.116980:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 293 00000040:00080000:1.0:1788830623.119528:0:12610:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788830623.119538:0:12610:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788830623.119586:0:12610:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1788830623.119594:0:12610:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1788830623.324675:0:11676:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788830623.324686:0:11676:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788830623.324760:0:11676:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1788830623.324767:0:11676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788830623.324902:0:11676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2547240a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11676:1875724595180032:192.168.201.21@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788830623.325019:0:11676:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e257fbd6480 going to sleep for 11 seconds 00000100:00100000:1.0:1788830623.328812:0:11676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2547240a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11676:1875724595180032:192.168.201.21@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788830623.331058:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830623.331372:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578422784 00000100:00100000:2.0:1788830623.331384:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578422784 00000100:00100000:2.0:1788830623.331498:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 232 00000100:00100000:2.0:1788830623.331510:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2547242680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+26:11631:x1875724578422784:12345-192.168.201.21@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788830623.331832:0:5833:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788830623.331926:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2547242680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+26:11631:x1875724578422784:12345-192.168.201.21@tcp:53:lhsmtool_posix.0 Request processed in 418us (877us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830623.331934:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 232 00000100:00100000:0.0:1788830623.335862:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830623.336421:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578423040 00000100:00100000:2.0:1788830623.336431:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578423040 00000100:00100000:2.0:1788830623.336504:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 233 00000100:00100000:2.0:1788830623.336515:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2547240a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+26:11631:x1875724578423040:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788830623.336551:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788830623.336576:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729600/0x575506951eea1a8c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa578910534662047 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830623.336693:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728e00/0x575506951eea1a93 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830623.336752:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728e00/0x575506951eea1a93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830623.336766:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728e00/0x575506951eea1a93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788830623.336776:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1788830623.336898:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729600/0x575506951eea1a8c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534662047 expref: 29 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830623.336923:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728e00/0x575506951eea1a93 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0xa578910534662047 expref: 28 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830623.336949:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e25530b0f00) 00010000:00010000:2.0:1788830623.336952:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788830623.336955:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2565728e00, rc 0) 00000100:00100000:2.0:1788830623.337021:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2547240a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+28:11631:x1875724578423040:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 Request processed in 508us (1170us total) trans 4294967514 rc 0/0 00000100:00100000:2.0:1788830623.337028:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 233 00000100:00100000:1.0:1788830623.342962:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830623.343079:0:8202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578423296 00000100:00100000:0.0:1788830623.343090:0:8202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578423296 00000100:00100000:0.0:1788830623.343204:0:8202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 234 00000100:00100000:0.0:1788830623.343214:0:8202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25654b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+28:11631:x1875724578423296:12345-192.168.201.21@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788830623.343298:0:8202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7a00/0x575506951eea1aa1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830623.343315:0:8202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7a00/0x575506951eea1aa1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830623.343329:0:8202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7a00/0x575506951eea1aa1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830623.343541:0:8202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7a00/0x575506951eea1aa1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830623.343550:0:8202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7a00/0x575506951eea1aa1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830623.343556:0:8202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7a00/0x575506951eea1aa1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830623.343562:0:8202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e25658d7a00 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:0.0:1788830623.343566:0:8202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7a00/0x575506951eea1aa1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830623.343574:0:8202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7a00/0x575506951eea1aa1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830623.343586:0:8202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e25530b0f00) 00010000:00010000:0.0:1788830623.343590:0:8202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788830623.343595:0:8202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7a00/0x575506951eea1aa1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830623.343612:0:8202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7a00/0x575506951eea1aa1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788830623.343809:0:8202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25654b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+29:11631:x1875724578423296:12345-192.168.201.21@tcp:57:lhsmtool_posix.0 Request processed in 596us (856us total) trans 4294967515 rc 0/0 00000100:00100000:0.0:1788830623.343817:0:8202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 234 00000040:00080000:1.0:1788830623.343956:0:11676:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788830623.343961:0:11676:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788830623.344443:0:11676:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1788830623.344452:0:11676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788830623.345047:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830623.345437:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578423424 00000100:00100000:1.0:1788830623.345456:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578423424 00000100:00100000:3.0:1788830623.345596:0:11161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 18 00000100:00100000:3.0:1788830623.345608:0:11161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25654d7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+29:2354:x1875724578423424:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788830623.345621:0:11161:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788830623.345656:0:11161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728e00/0x575506951eea1a93 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.21@tcp remote: 0xa578910534662047 expref: 29 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830623.345675:0:11161:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e25530b0f00) 00010000:00010000:3.0:1788830623.345681:0:11161:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788830623.345754:0:11161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25654d7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+28:2354:x1875724578423424:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 149us (709us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830623.345762:0:11161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 18 00000100:00100000:3.0:1788830623.348994:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830623.349215:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578423680 00000100:00100000:1.0:1788830623.349224:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578423680 00000100:00100000:1.0:1788830623.349278:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 63 00000100:00100000:1.0:1788830623.349288:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25654d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+28:11631:x1875724578423680:12345-192.168.201.21@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788830623.349534:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25654d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+29:11631:x1875724578423680:12345-192.168.201.21@tcp:35:lhsmtool_posix.0 Request processed in 247us (548us total) trans 4294967516 rc 0/0 00000100:00100000:1.0:1788830623.349552:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 63 00000100:00100000:1.0:1788830623.452169:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2565cc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1745cc3d-3952-4cd4-9020-9b8acb483105:3308:1875724595180160:0@lo:400:kworker.0 00000100:00100000:1.0:1788830623.452247:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788830623.452653:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e255130ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1875724595180544:0@lo:400:kworker.0 00000100:00100000:2.0:1788830623.452693:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788830623.452764:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595180544 00000100:00100000:2.0:1788830623.452771:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595180544 00000100:00100000:2.0:1788830623.452831:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788830623.452841:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2445d41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875724595180544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788830623.452888:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2551308380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875724595180288:0@lo:400:kworker.0 00000100:00100000:2.0:1788830623.452894:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2445d41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875724595180544:12345-0@lo:400:kworker.0 Request processed in 55us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830623.452901:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788830623.452913:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830623.453685:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788830623.453697:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2551309f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875724595180416:0@lo:400:kworker.0 00000100:00100000:1.0:1788830623.453749:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830623.453805:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595180416 00000100:00100000:1.0:1788830623.453810:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595180416 00000100:00100000:3.0:1788830623.453840:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595180160 00000100:00100000:1.0:1788830623.453848:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788830623.453849:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595180160 00000100:00100000:1.0:1788830623.453859:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25654b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3309:x1875724595180416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788830623.453889:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:3.0:1788830623.453900:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255d948050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+19:3308:x1875724595180160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788830623.453905:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25654b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3309:x1875724595180416:12345-0@lo:400:kworker.0 Request processed in 46us (153us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830623.453913:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788830623.453957:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2551309f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875724595180416:0@lo:400:kworker.0 00000100:00100000:3.0:1788830623.453958:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255d948050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+19:3308:x1875724595180160:12345-0@lo:400:kworker.0 Request processed in 58us (1706us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830623.453970:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00080000:1.0:1788830623.454006:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788830623.454028:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2565cc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1745cc3d-3952-4cd4-9020-9b8acb483105:3308:1875724595180160:0@lo:400:kworker.0 00000100:00100000:0.0:1788830623.456485:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788830623.456504:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e256549aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875724595180800:0@lo:400:kworker.0 00000100:00100000:1.0:1788830623.456606:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595180288 00000100:00100000:1.0:1788830623.456614:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595180288 00000100:00100000:1.0:1788830623.456670:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788830623.456675:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830623.456678:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25654b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875724595180288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788830623.456726:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595180800 00000100:00100000:0.0:1788830623.456730:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595180800 00000100:00100000:1.0:1788830623.456741:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25654b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875724595180288:12345-0@lo:400:kworker.0 Request processed in 65us (3827us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830623.456748:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788830623.456764:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00080000:1.0:1788830623.456767:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788830623.456769:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e256549bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3310:x1875724595180800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788830623.456802:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e256549bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3310:x1875724595180800:12345-0@lo:400:kworker.0 Request processed in 32us (126us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830623.456808:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788830623.456843:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e256549aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875724595180800:0@lo:400:kworker.0 00000100:00100000:0.0:1788830623.456874:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2551308380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875724595180288:0@lo:400:kworker.0 00000100:00100000:0.0:1788830623.456920:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2551309f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1875724595180672:0@lo:400:kworker.0 00000100:00100000:0.0:1788830623.456947:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830623.457105:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595180672 00000100:00100000:0.0:1788830623.457110:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595180672 00000100:00100000:0.0:1788830623.457141:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788830623.457147:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e256549aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875724595180672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788830623.457194:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e256549aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875724595180672:12345-0@lo:400:kworker.0 Request processed in 46us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830623.457207:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788830623.457236:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2551309f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1875724595180672:0@lo:400:kworker.0 00000100:00080000:0.0:1788830623.457259:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788830623.459948:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e255130ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1875724595180544:0@lo:400:kworker.0 00010000:00010000:0.0:1788830623.774054:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788830623.964413:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25658c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875724595180928:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788830623.964506:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788830623.965775:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595180928 00000100:00100000:2.0:1788830623.965787:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595180928 00000100:00100000:2.0:1788830623.965863:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788830623.965874:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257f805f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1875724595180928:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788830623.965913:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788830623.965981:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257f805f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1875724595180928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (1473us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830623.965987:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788830623.966038:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25658c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875724595180928:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788830624.796940:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788830624.855046:0:12662:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788830624.855056:0:12662:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788830624.855102:0:12662:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1788830624.855110:0:12662:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788830625.064426:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830625.064527:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578423936 00000100:00100000:1.0:1788830625.064537:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578423936 00000100:00100000:1.0:1788830625.064630:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 235 00000100:00100000:1.0:1788830625.064641:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255130ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+29:11651:x1875724578423936:12345-192.168.201.21@tcp:101:lfs.0 00010000:00010000:1.0:1788830625.064672:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788830625.064693:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8c200/0x575506951eea1aa8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa57891053466204e expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830625.064870:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8dc00/0x575506951eea1aaf lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830625.064884:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8dc00/0x575506951eea1aaf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830625.064897:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8dc00/0x575506951eea1aaf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788830625.064907:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1788830625.065027:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8c200/0x575506951eea1aa8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0xa57891053466204e expref: 32 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830625.065062:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8dc00/0x575506951eea1aaf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0xa57891053466204e expref: 31 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830625.065071:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e25530b0f00) 00010000:00010000:1.0:1788830625.065074:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788830625.065077:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e257fa8dc00, rc 0) 00000100:00100000:1.0:1788830625.065138:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255130ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+31:11651:x1875724578423936:12345-192.168.201.21@tcp:101:lfs.0 Request processed in 499us (722us total) trans 4294967517 rc 0/0 00000100:00100000:1.0:1788830625.065144:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 235 00000100:00080000:0.0:1788830625.065271:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788830625.067903:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830625.068021:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578424064 00000100:00100000:2.0:1788830625.068031:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578424064 00000100:00100000:2.0:1788830625.068083:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 236 00000100:00100000:2.0:1788830625.068091:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25654d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+31:11651:x1875724578424064:12345-192.168.201.21@tcp:54:lfs.0 00010000:00010000:2.0:1788830625.068157:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728c00/0x575506951eea1abd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830625.068173:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728c00/0x575506951eea1abd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830625.068185:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728c00/0x575506951eea1abd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830625.068208:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728c00/0x575506951eea1abd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830625.068214:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728c00/0x575506951eea1abd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830625.068221:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728c00/0x575506951eea1abd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830625.068227:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2565728c00 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:2.0:1788830625.068232:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728c00/0x575506951eea1abd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830625.068238:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728c00/0x575506951eea1abd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830625.068248:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e25530b0f00) 00010000:00010000:2.0:1788830625.068251:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788830625.068267:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728c00/0x575506951eea1abd lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830625.068273:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728c00/0x575506951eea1abd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788830625.068351:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25654d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+31:11651:x1875724578424064:12345-192.168.201.21@tcp:54:lfs.0 Request processed in 260us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830625.068358:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 236 00000100:00100000:2.0:1788830625.163282:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830625.166085:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578424192 00000100:00100000:1.0:1788830625.166101:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578424192 00000100:00100000:1.0:1788830625.166188:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 72 00000100:00100000:1.0:1788830625.166203:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25658c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+7:2353:x1875724578424192:12345-192.168.201.21@tcp:101:cat.0 00010000:00010000:1.0:1788830625.166224:0:6679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788830625.166247:0:6679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000618e77a/0x575506951eea1ac4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa578910534662055 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788830625.166247:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:1.0:1788830625.166277:0:6679:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a9f639d, atime: 0x6a9f639d, ctime: 0x6a9f639d, blocks: 0xb 00010000:00010000:1.0:1788830625.166299:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=378s v=(0 0) 00010000:00010000:1.0:1788830625.166304:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788830625.166314:0:6679:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000618e77a/0x575506951eea1ac4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534662055 expref: 8 pid: 6679 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830625.166333:0:6679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000618e77a/0x575506951eea1ac4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534662055 expref: 8 pid: 6679 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830625.166379:0:6679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e257fa8c200, rc 0) 00000100:00100000:1.0:1788830625.166454:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25658c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+8:2353:x1875724578424192:12345-192.168.201.21@tcp:101:cat.0 Request processed in 257us (3182us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830625.166463:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 72 00000100:00100000:3.0:1788830625.171107:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830625.171660:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578424320 00000100:00100000:1.0:1788830625.171671:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578424320 00002000:00100000:1.0:1788830625.171756:0:6683:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff9e25654d6a00 x1875724578424320/t0(0) o3->1ef2fe7a-e5ec-4085-8326-b72aa00876cd@192.168.201.21@tcp:76/0 lens 488/0 e 0 to 0 dl 1788830636 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788830625.171768:0:6683:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e25654d6a00 with x1875724578424320 ext(0->4095) 00002000:00010000:1.0:1788830625.171775:0:6683:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e25654d6a00 00000100:00100000:1.0:1788830625.171809:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 7 00000100:00100000:1.0:1788830625.171819:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25654d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+8:2352:x1875724578424320:12345-192.168.201.21@tcp:3:cat.0 00000100:00100000:1.0:1788830625.175133:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25654d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+8:2352:x1875724578424320:12345-192.168.201.21@tcp:3:cat.0 Request processed in 3303us (4025us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1788830625.175149:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 7 00002000:00100000:1.0:1788830625.175161:0:6683:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff9e25654d6a00 x1875724578424320/t0(0) o3->1ef2fe7a-e5ec-4085-8326-b72aa00876cd@192.168.201.21@tcp:76/0 lens 488/4536 e 0 to 0 dl 1788830636 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788830625.175173:0:6683:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e25654d6a00 with x1875724578424320 ext(0->4095) 00002000:00010000:1.0:1788830625.175180:0:6683:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e25654d6a00 00010000:00010000:0.0:1788830625.822936:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788830626.844400:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788830627.110104:0:7646:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000004:00080000:1.0:1788830627.557908:0:6697:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 380905195471ns, next at 381905192925ns, rc = 0 00000100:00100000:3.0:1788830627.558364:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257f804e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875724595181056:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788830627.558460:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830627.558537:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595181056 00000100:00100000:3.0:1788830627.558545:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595181056 00000100:00100000:3.0:1788830627.558625:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788830627.558736:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25654d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1875724595181056:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788830627.558772:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788830627.558818:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25654d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1875724595181056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830627.558825:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:3.0:1788830627.558848:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788830627.558887:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257f804e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875724595181056:0@lo:13:osp-pre-0-0.0 00000001:00080000:0.0:1788830627.608890:0:6709:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967322 is committed 00000001:00080000:0.0:1788830627.608920:0:6709:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00000001:00080000:3.0:1788830627.617754:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967515 is committed 00000020:00080000:3.0:1788830627.617778:0:5855:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9e2548034b40 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:3.0:1788830627.617783:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9e254504c600 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9e25480340c0 00000020:00080000:3.0:1788830627.617787:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9e254504c500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9e2565485800 00000001:00080000:3.0:1788830627.617814:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967517 is committed 00000004:00080000:3.0:1788830627.617823:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 11 committed 00000020:00080000:0.0:1788830627.617914:0:5866:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 5 00000020:00080000:3.0:1788830627.617939:0:5855:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000100:00100000:3.0:1788830627.618018:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788830627.618041:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25654d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875724595181184:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1788830627.618123:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:0.0:1788830627.618141:0:5866:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000100:00100000:0.0:1788830627.618162:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595181184 00000100:00100000:0.0:1788830627.618172:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595181184 00000100:00100000:0.0:1788830627.618223:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788830627.618231:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25654d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875724595181184:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1788830627.618457:0:6677:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1788830627.618461:0:6677:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1788830621 -> 1788830621 00002000:00010000:0.0:1788830627.618463:0:6677:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 1788830621 -> 1788830621 00002000:00010000:0.0:1788830627.618465:0:6677:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1788830621 -> 1788830621 00002000:00010000:0.0:1788830627.618467:0:6677:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1788830627.618518:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25654d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3307:x1875724595181184:12345-0@lo:2:osp-syn-0-0.0 Request processed in 287us (395us total) trans 4294967324 rc 0/0 00000100:00100000:0.0:1788830627.618526:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788830627.618546:0:3307:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967323 gen 2 00000004:00080000:3.0:1788830627.618552:0:3307:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967323 committed transno 4294967323 00000100:00100000:3.0:1788830627.618664:0:3307:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9e25654d7b80 x1875724595181184/t4294967324(4294967324) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1788830643 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1788830627.618679:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e25654d7b80/2, rc 0, transno 4294967324 00000100:00100000:3.0:1788830627.618685:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25654d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875724595181184:0@lo:2:osp-syn-0-0.0 00010000:00010000:0.0:1788830627.867957:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788830628.235841:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830628.235968:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830628.236013:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830628.236043:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578424448 00000100:00100000:3.0:1788830628.236052:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830628.236056:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578424448 00000100:00100000:1.0:1788830628.236074:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578424576 00000100:00100000:1.0:1788830628.236081:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578424576 00000100:00100000:3.0:1788830628.236085:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830628.236116:0:8202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578424960 00000100:00100000:3.0:1788830628.236122:0:8202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578424960 00000100:00100000:0.0:1788830628.236136:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 295 00000100:00100000:0.0:1788830628.236150:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255d949c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+13:2353:x1875724578424448:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:1.0:1788830628.236151:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 145 00000100:00100000:1.0:1788830628.236165:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2545cbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+18:2353:x1875724578424576:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:2.0:1788830628.236218:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578424832 00000100:00100000:2.0:1788830628.236224:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578424832 00000100:00100000:2.0:1788830628.236260:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578424704 00000100:00100000:1.0:1788830628.236261:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2545cbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+18:2353:x1875724578424576:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 98us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830628.236265:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578424704 00000100:00100000:0.0:1788830628.236318:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255d949c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+13:2353:x1875724578424448:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 172us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830628.236326:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 295 00000100:00100000:0.0:1788830628.236364:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 92 00000100:00100000:0.0:1788830628.236371:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2565cc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+5:2352:x1875724578424832:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:0.0:1788830628.236394:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2565cc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+5:2352:x1875724578424832:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 24us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830628.236400:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 92 00000100:00100000:3.0:1788830628.236418:0:8202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 146 00000100:00100000:3.0:1788830628.236429:0:8202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255005f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2154ea6-69cb-4a30-aac0-000fba13e98b+5:2352:x1875724578424960:12345-192.168.201.21@tcp:400:kworker.0 00000100:00080000:0.0:1788830628.236450:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788830628.236455:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788830628.236458:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788830628.236463:0:8202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255005f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2154ea6-69cb-4a30-aac0-000fba13e98b+5:2352:x1875724578424960:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 36us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830628.236471:0:8202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 146 00000100:00100000:2.0:1788830628.236696:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 93 00000100:00100000:2.0:1788830628.236705:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257f733100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+7:2352:x1875724578424704:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:2.0:1788830628.236783:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257f733100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+7:2352:x1875724578424704:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 80us (731us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830628.236790:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 93 00000100:00100000:1.0:1788830628.239449:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 145 00000100:00100000:3.0:1788830628.573814:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25654d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1745cc3d-3952-4cd4-9020-9b8acb483105:3309:1875724595181312:0@lo:400:kworker.0 00000100:00100000:3.0:1788830628.573885:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830628.573946:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2445d00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1875724595181824:0@lo:400:kworker.0 00000100:00100000:3.0:1788830628.573973:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830628.574001:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788830628.574007:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25658e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875724595181440:0@lo:400:kworker.0 00000100:00100000:3.0:1788830628.574029:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830628.574047:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2445d01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875724595181952:0@lo:400:kworker.0 00000100:00100000:3.0:1788830628.574070:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830628.574098:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25747c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875724595181568:0@lo:400:kworker.0 00000100:00100000:3.0:1788830628.574120:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830628.574301:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788830628.574308:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2445d01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1875724595181696:0@lo:400:kworker.0 00000100:00100000:3.0:1788830628.574334:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830628.574362:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595181312 00000100:00100000:3.0:1788830628.574371:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595181312 00000100:00100000:3.0:1788830628.574429:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:3.0:1788830628.574438:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255d94a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1745cc3d-3952-4cd4-9020-9b8acb483105+19:3309:x1875724595181312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788830628.574491:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255d94a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1745cc3d-3952-4cd4-9020-9b8acb483105+19:3309:x1875724595181312:12345-0@lo:400:kworker.0 Request processed in 54us (606us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830628.574498:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:3.0:1788830628.574532:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595181824 00000100:00100000:3.0:1788830628.574536:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595181824 00000100:00100000:3.0:1788830628.574588:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595181440 00000100:00100000:3.0:1788830628.574592:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595181440 00000100:00100000:3.0:1788830628.574604:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595181696 00000100:00100000:3.0:1788830628.574607:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595181696 00000100:00100000:3.0:1788830628.574622:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788830628.574628:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2445d03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875724595181824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788830628.574674:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2445d03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875724595181824:12345-0@lo:400:kworker.0 Request processed in 46us (700us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830628.574681:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788830628.574694:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788830628.574699:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2445d02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875724595181440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788830628.574754:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2445d02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875724595181440:12345-0@lo:400:kworker.0 Request processed in 54us (723us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830628.574760:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788830628.574774:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788830628.574780:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2544ee6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875724595181696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788830628.574822:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2544ee6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875724595181696:12345-0@lo:400:kworker.0 Request processed in 43us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830628.574828:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788830628.574851:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595181952 00000100:00100000:3.0:1788830628.574855:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595181952 00000100:00100000:3.0:1788830628.574886:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595181568 00000100:00100000:3.0:1788830628.574889:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595181568 00000100:00100000:3.0:1788830628.574910:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788830628.574916:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2544ee5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875724595181952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788830628.574948:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2544ee5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875724595181952:12345-0@lo:400:kworker.0 Request processed in 32us (876us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830628.574954:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788830628.574966:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788830628.574973:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2544ee7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3307:x1875724595181568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788830628.574999:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2544ee7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3307:x1875724595181568:12345-0@lo:400:kworker.0 Request processed in 27us (877us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830628.575013:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00080000:3.0:1788830628.575041:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788830628.575046:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788830628.575078:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2445d01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1875724595181696:0@lo:400:kworker.0 00000100:00100000:3.0:1788830628.575090:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25747c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875724595181568:0@lo:400:kworker.0 00000100:00100000:3.0:1788830628.575117:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25658e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875724595181440:0@lo:400:kworker.0 00000100:00100000:3.0:1788830628.575139:0:3309:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:3.0:1788830628.575144:0:3309:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e25654d4380, transno 4294967310 00000100:00100000:3.0:1788830628.575155:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2445d01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875724595181952:0@lo:400:kworker.0 00000100:00100000:3.0:1788830628.575165:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25654d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1745cc3d-3952-4cd4-9020-9b8acb483105:3309:1875724595181312:0@lo:400:kworker.0 00000100:00100000:3.0:1788830628.575174:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2445d00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1875724595181824:0@lo:400:kworker.0 00010000:00010000:1.0:1788830628.891850:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788830629.085847:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2551309f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875724595182080:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788830629.085917:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788830629.086026:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595182080 00000100:00100000:2.0:1788830629.086033:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595182080 00000100:00100000:2.0:1788830629.086105:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788830629.086114:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2544ea8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875724595182080:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788830629.086147:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788830629.086190:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2544ea8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875724595182080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830629.086209:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788830629.086671:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2551309f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875724595182080:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788830629.330548:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830629.333252:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578425088 00000100:00100000:0.0:1788830629.333265:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578425088 00000100:00100000:0.0:1788830629.333379:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 237 00000100:00100000:0.0:1788830629.333391:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2544ee7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+18:11297:x1875724578425088:12345-192.168.201.21@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1788830629.333507:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2544ee7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+18:11297:x1875724578425088:12345-192.168.201.21@tcp:60:lhsmtool_posix.0 Request processed in 118us (2978us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830629.333515:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 237 00000100:00100000:3.0:1788830629.346037:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830629.346174:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578425344 00000100:00100000:1.0:1788830629.346183:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578425344 00000100:00100000:1.0:1788830629.346240:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 64 00000100:00100000:1.0:1788830629.346252:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2544ee4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+18:11297:x1875724578425344:12345-192.168.201.21@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788830629.346963:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2544ee4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+19:11297:x1875724578425344:12345-192.168.201.21@tcp:35:lhsmtool_posix.0 Request processed in 711us (931us total) trans 4294967518 rc 0/0 00000100:00100000:1.0:1788830629.346972:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 64 00000100:00100000:1.0:1788830629.580272:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830629.580457:0:8202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578425472 00000100:00100000:3.0:1788830629.580467:0:8202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578425472 00000100:00100000:3.0:1788830629.581432:0:8202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 238 00000100:00100000:3.0:1788830629.581448:0:8202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257f806a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2154ea6-69cb-4a30-aac0-000fba13e98b+5:12103:x1875724578425472:12345-192.168.201.21@tcp:101:lsof.0 00010000:00010000:3.0:1788830629.581474:0:8202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788830629.581566:0:8202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945400/0x575506951eea1acb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa57891053466205c expref: -99 pid: 8202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830629.581635:0:8202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944200/0x575506951eea1ad2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830629.581668:0:8202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944200/0x575506951eea1ad2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830629.581680:0:8202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944200/0x575506951eea1ad2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788830629.581732:0:8202:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788830629.581736:0:8202:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788830629.581775:0:8202:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944200/0x575506951eea1ad2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830629.581800:0:8202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d945400/0x575506951eea1acb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0xa57891053466205c expref: 7 pid: 8202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830629.581821:0:8202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944200/0x575506951eea1ad2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0xa57891053466205c expref: 6 pid: 8202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830629.581830:0:8202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e257480c400) 00010000:00010000:3.0:1788830629.581833:0:8202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788830629.581837:0:8202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e257d944200, rc 0) 00000100:00100000:3.0:1788830629.581905:0:8202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257f806a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2154ea6-69cb-4a30-aac0-000fba13e98b+6:12103:x1875724578425472:12345-192.168.201.21@tcp:101:lsof.0 Request processed in 463us (1644us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830629.581912:0:8202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 238 00010000:00010000:0.0:1788830629.921897:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788830630.494123:0:11676:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788830630.494134:0:11676:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788830630.496837:0:11676:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:0.0:1788830630.496851:0:11676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1788830630.940005:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788830631.965104:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788830632.561212:0:12864:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 21:23:50 (1788830630) 00000100:00100000:1.0:1788830632.669022:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788830632.669063:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257f807b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875724595182208:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788830632.669136:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830632.669208:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595182208 00000100:00100000:1.0:1788830632.669216:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595182208 00000100:00100000:1.0:1788830632.669275:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788830632.669284:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257f806680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1875724595182208:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788830632.669333:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788830632.669395:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257f806680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1875724595182208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830632.669402:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788830632.669460:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257f807b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875724595182208:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788830632.669944:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:0.0:1788830632.734989:0:6709:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00000020:00080000:3.0:1788830632.756586:0:5855:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:0.0:1788830632.756659:0:5866:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:0.0:1788830632.756675:0:5866:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000001:00080000:3.0:1788830632.756966:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967518 is committed 00000004:00080000:3.0:1788830632.756977:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 12 committed 00010000:00010000:1.0:1788830632.988827:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788830633.350290:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830633.350340:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830633.350378:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578425728 00000100:00100000:0.0:1788830633.350392:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578425728 00000100:00100000:3.0:1788830633.350396:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830633.350423:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578425600 00000100:00100000:1.0:1788830633.350430:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578425600 00000100:00100000:3.0:1788830633.350442:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00080000:3.0:1788830633.350478:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788830633.350497:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578425856 00000100:00100000:2.0:1788830633.350502:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578425856 00000100:00100000:2.0:1788830633.350545:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 96 00000100:00100000:2.0:1788830633.350556:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25654d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+7:2352:x1875724578425856:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:2.0:1788830633.350648:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25654d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+7:2352:x1875724578425856:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 94us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830633.350656:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 96 00000100:00100000:1.0:1788830633.350737:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 297 00000100:00100000:1.0:1788830633.350747:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255d948450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+13:2352:x1875724578425600:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:0.0:1788830633.350748:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578426112 00000100:00100000:0.0:1788830633.350754:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578426112 00000100:00100000:1.0:1788830633.350782:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255d948450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+13:2352:x1875724578425600:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 37us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830633.350789:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 150 00000100:00100000:1.0:1788830633.350797:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 297 00000100:00100000:0.0:1788830633.350871:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25654d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+18:2353:x1875724578425728:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:0.0:1788830633.350917:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25654d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+18:2353:x1875724578425728:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 120us (638us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830633.350925:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 150 00000100:00100000:0.0:1788830633.350942:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 151 00000100:00100000:0.0:1788830633.350950:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25654d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2154ea6-69cb-4a30-aac0-000fba13e98b+6:2352:x1875724578426112:12345-192.168.201.21@tcp:400:kworker.0 00000100:00080000:3.0:1788830633.351236:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788830633.351241:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788830633.351461:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25654d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2154ea6-69cb-4a30-aac0-000fba13e98b+6:2352:x1875724578426112:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 252us (760us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830633.351479:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 151 00000100:00100000:3.0:1788830633.354875:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830633.358424:0:12010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578425984 00000100:00100000:0.0:1788830633.358437:0:12010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578425984 00000100:00100000:0.0:1788830633.358597:0:12010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 97 00000100:00100000:0.0:1788830633.358610:0:12010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25658e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+5:2353:x1875724578425984:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:0.0:1788830633.358698:0:12010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25658e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+5:2353:x1875724578425984:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 92us (3831us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830633.358706:0:12010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 97 00000100:00080000:3.0:1788830633.361542:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788830633.692914:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25747c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875724595182592:0@lo:400:kworker.0 00000100:00100000:3.0:1788830633.692991:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830633.693053:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788830633.693060:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25747c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1875724595182720:0@lo:400:kworker.0 00000100:00100000:3.0:1788830633.693087:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830633.693122:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595182592 00000100:00100000:3.0:1788830633.693129:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595182592 00000100:00100000:3.0:1788830633.693183:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788830633.693192:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2445d01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875724595182592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788830633.693243:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2445d01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875724595182592:12345-0@lo:400:kworker.0 Request processed in 52us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830633.693251:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788830633.693273:0:8202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595182720 00000100:00100000:3.0:1788830633.693277:0:8202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595182720 00000100:00100000:3.0:1788830633.693307:0:8202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788830633.693312:0:8202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257fac9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875724595182720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788830633.693350:0:8202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257fac9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875724595182720:12345-0@lo:400:kworker.0 Request processed in 37us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830633.693356:0:8202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00080000:3.0:1788830633.693372:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788830633.693400:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25747c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1875724595182720:0@lo:400:kworker.0 00000100:00100000:3.0:1788830633.693416:0:3307:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:3.0:1788830633.693421:0:3307:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e25654d7b80, transno 4294967324 00000100:00100000:3.0:1788830633.693429:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25747c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875724595182592:0@lo:400:kworker.0 00000100:00100000:0.0:1788830633.693528:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25747c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1745cc3d-3952-4cd4-9020-9b8acb483105:3309:1875724595182336:0@lo:400:kworker.0 00000100:00100000:0.0:1788830633.693560:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830633.693594:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2445d00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1875724595182848:0@lo:400:kworker.0 00000100:00100000:0.0:1788830633.693613:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830633.693628:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788830633.693633:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25747c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875724595182464:0@lo:400:kworker.0 00000100:00100000:0.0:1788830633.693649:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830633.693661:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2445d01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875724595182976:0@lo:400:kworker.0 00000100:00100000:0.0:1788830633.693677:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830633.694005:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595182848 00000100:00100000:0.0:1788830633.694010:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595182848 00000100:00100000:0.0:1788830633.694036:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595182464 00000100:00100000:0.0:1788830633.694038:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595182464 00000100:00100000:0.0:1788830633.694051:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788830633.694057:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2551308380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875724595182848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788830633.694088:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2551308380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875724595182848:12345-0@lo:400:kworker.0 Request processed in 31us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830633.694094:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788830633.694104:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788830633.694109:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2551309f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875724595182464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788830633.694128:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2551309f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875724595182464:12345-0@lo:400:kworker.0 Request processed in 20us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830633.694133:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788830633.694150:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595182976 00000100:00100000:0.0:1788830633.694153:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595182976 00000100:00100000:0.0:1788830633.694174:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788830633.694179:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2551309500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875724595182976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788830633.694202:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2551309500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875724595182976:12345-0@lo:400:kworker.0 Request processed in 23us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830633.694216:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00080000:0.0:1788830633.694233:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788830633.694235:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788830633.694253:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25747c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875724595182464:0@lo:400:kworker.0 00000100:00100000:0.0:1788830633.694262:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2445d01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875724595182976:0@lo:400:kworker.0 00000100:00100000:0.0:1788830633.694269:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2445d00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1875724595182848:0@lo:400:kworker.0 00000100:00100000:3.0:1788830633.694410:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595182336 00000100:00100000:3.0:1788830633.694414:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595182336 00000100:00100000:3.0:1788830633.694447:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:3.0:1788830633.694453:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255d94ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1745cc3d-3952-4cd4-9020-9b8acb483105+19:3309:x1875724595182336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788830633.694496:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255d94ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1745cc3d-3952-4cd4-9020-9b8acb483105+19:3309:x1875724595182336:12345-0@lo:400:kworker.0 Request processed in 44us (936us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830633.694502:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:3.0:1788830633.694529:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25747c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1745cc3d-3952-4cd4-9020-9b8acb483105:3309:1875724595182336:0@lo:400:kworker.0 00010000:00010000:0.0:1788830634.013875:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788830634.204102:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788830634.204128:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e255130a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875724595183104:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788830634.204203:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830634.204298:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595183104 00000100:00100000:1.0:1788830634.204306:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595183104 00000100:00100000:1.0:1788830634.204362:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788830634.204372:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255130b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875724595183104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788830634.204410:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788830634.204475:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255130b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875724595183104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830634.204482:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788830634.204544:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e255130a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875724595183104:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788830635.036001:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788830636.059948:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788830636.418916:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830636.419011:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578426368 00000100:00100000:3.0:1788830636.419022:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578426368 00000100:00100000:3.0:1788830636.419150:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 65 00000100:00100000:3.0:1788830636.419162:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257f807b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+18:12324:x1875724578426368:12345-192.168.201.21@tcp:35:umount.0 00000100:00100000:3.0:1788830636.419570:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257f807b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+19:12324:x1875724578426368:12345-192.168.201.21@tcp:35:umount.0 Request processed in 408us (661us total) trans 4294967519 rc 0/0 00000100:00100000:3.0:1788830636.419578:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 65 00000100:00080000:0.0:1788830636.419949:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788830636.422292:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830636.422392:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578426624 00000100:00100000:2.0:1788830636.422402:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578426624 00000100:00100000:2.0:1788830636.422511:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 66 00000100:00100000:2.0:1788830636.422522:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257f807800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+19:12324:x1875724578426624:12345-192.168.201.21@tcp:35:umount.0 00000100:00100000:2.0:1788830636.422920:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257f807800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+20:12324:x1875724578426624:12345-192.168.201.21@tcp:35:umount.0 Request processed in 398us (644us total) trans 4294967520 rc 0/0 00000100:00100000:2.0:1788830636.422929:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 66 00000100:00100000:1.0:1788830636.428086:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830636.428171:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578426880 00000100:00100000:3.0:1788830636.428182:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578426880 00000100:00100000:3.0:1788830636.428231:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 67 00000100:00100000:3.0:1788830636.428242:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25629b1c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+20:12324:x1875724578426880:12345-192.168.201.21@tcp:35:umount.0 00000100:00100000:3.0:1788830636.428701:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25629b1c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+21:12324:x1875724578426880:12345-192.168.201.21@tcp:35:umount.0 Request processed in 459us (624us total) trans 4294967521 rc 0/0 00000100:00100000:3.0:1788830636.428771:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 67 00000100:00100000:1.0:1788830636.446096:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830636.446184:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578427136 00000100:00100000:3.0:1788830636.446194:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578427136 00000100:00100000:3.0:1788830636.446284:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 68 00000100:00100000:3.0:1788830636.446306:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257f804380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+21:12324:x1875724578427136:12345-192.168.201.21@tcp:35:umount.0 00000100:00100000:3.0:1788830636.449015:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257f804380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+22:12324:x1875724578427136:12345-192.168.201.21@tcp:35:umount.0 Request processed in 2711us (2919us total) trans 4294967522 rc 0/0 00000100:00100000:3.0:1788830636.449026:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 68 00000100:00100000:0.0:1788830636.471990:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830636.472023:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830636.472044:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830636.472066:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578427264 00000100:00100000:2.0:1788830636.472076:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578427264 00000100:00100000:1.0:1788830636.472107:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578427520 00000100:00100000:1.0:1788830636.472111:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578427520 00000100:00100000:2.0:1788830636.472139:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578427392 00000100:00100000:2.0:1788830636.472142:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578427392 00000100:00100000:0.0:1788830636.472169:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830636.475193:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 19 00000100:00100000:0.0:1788830636.475218:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255130a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+15:2355:x1875724578427264:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788830636.475242:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788830636.475269:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2565729200/0x575506951eea0b58 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661bee expref: 15 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830636.475299:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788830636.475387:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255130a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+14:2355:x1875724578427264:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 179us (3403us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830636.475422:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 19 00000100:00100000:0.0:1788830636.475452:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 20 00000100:00100000:0.0:1788830636.475459:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2445d00000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+13:2355:x1875724578427520:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788830636.475468:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788830636.475480:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2445b7f600/0x575506951eea0d50 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661cb9 expref: 13 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830636.475489:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788830636.475510:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2445d00000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+12:2355:x1875724578427520:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 51us (3487us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830636.475517:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 20 00000100:00100000:0.0:1788830636.475532:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 21 00000100:00100000:0.0:1788830636.475539:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2445d01f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+11:2355:x1875724578427392:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788830636.475546:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788830636.475555:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e25820fe000/0x575506951eea0abe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661bb6 expref: 11 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830636.475565:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788830636.475584:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2445d01f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+10:2355:x1875724578427392:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 46us (3539us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830636.475590:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 21 00000100:00100000:0.0:1788830636.475617:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578427648 00000100:00100000:0.0:1788830636.475625:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578427648 00000100:00100000:0.0:1788830636.475683:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 74 00000100:00100000:0.0:1788830636.475690:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25654d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+5:2351:x1875724578427648:12345-192.168.201.21@tcp:9:umount.0 00000020:00000080:0.0:1788830636.475760:0:6677:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x575506951eea0e30 00000100:00080000:0.0:1788830636.475771:0:6677:0:(import.c:65:import_set_state_nolock()) ffff9e2544c04800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788830636.475817:0:6677:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:0.0:1788830636.476089:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25654d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+2:2351:x1875724578427648:12345-192.168.201.21@tcp:9:umount.0 Request processed in 399us (3918us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830636.476097:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 74 00000100:00080000:0.0:1788830636.476120:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788830636.476130:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788830636.483316:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830636.483579:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578428032 00000100:00100000:0.0:1788830636.483591:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578428032 00000100:00100000:0.0:1788830636.483785:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 75 00000100:00100000:0.0:1788830636.483798:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257f805f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+7:2351:x1875724578428032:12345-192.168.201.21@tcp:9:umount.0 00000020:00000080:0.0:1788830636.483832:0:6680:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x575506951eea1098 00000020:00010000:0.0:1788830636.483840:0:6680:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9e255179a800: total 0 00000100:00080000:0.0:1788830636.483844:0:6680:0:(import.c:65:import_set_state_nolock()) ffff9e2551798000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788830636.483887:0:6680:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000020:00010000:1.0:1788830636.484170:0:5820:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9e255179a800: total 0 00010000:00010000:1.0:1788830636.484226:0:5820:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e255179a800, canceled 0 locks, left on hash table 2. 00010000:00010000:1.0:1788830636.484293:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000d1128c3/0x575506951eea1426 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661e87 expref: 6 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830636.484334:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000618e77a/0x575506951eea1ac4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.21@tcp remote: 0xa578910534662055 expref: 5 pid: 6679 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830636.484357:0:5820:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e255179a800, canceled 2 locks, left on hash table 0. 00010000:00010000:1.0:1788830636.484369:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788830636.484372:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788830636.484374:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788830636.484649:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257f805f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+2:2351:x1875724578428032:12345-192.168.201.21@tcp:9:umount.0 Request processed in 853us (1343us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830636.484657:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 75 00000100:00080000:2.0:1788830636.484887:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788830636.492802:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830636.493047:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578429056 00000100:00100000:2.0:1788830636.493058:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578429056 00000100:00100000:2.0:1788830636.493151:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 239 00000100:00100000:2.0:1788830636.493176:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25654d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+22:2351:x1875724578429056:12345-192.168.201.21@tcp:39:umount.0 00000020:00000080:2.0:1788830636.493212:0:5833:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x575506951eea0acc 00000020:00010000:2.0:1788830636.493235:0:5833:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9e2446c87800: total 0 00000100:00080000:2.0:1788830636.493240:0:5833:0:(import.c:65:import_set_state_nolock()) ffff9e2446c81800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788830636.493273:0:5833:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967522 00000100:00100000:2.0:1788830636.493704:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25654d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1ef2fe7a-e5ec-4085-8326-b72aa00876cd+21:2351:x1875724578429056:12345-192.168.201.21@tcp:39:umount.0 Request processed in 528us (1006us total) trans 4294967523 rc 0/0 00000020:00010000:1.0:1788830636.493874:0:5821:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9e2446c87800: total 0 00010000:00010000:1.0:1788830636.493880:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788830636.493920:0:5821:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e2446c87800, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1788830636.493954:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e257480cd00) 00010000:00010000:1.0:1788830636.493958:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788830636.493967:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff200/0x575506951eea0db2 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661cce expref: 21 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830636.493993:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e25530b0b00) 00010000:00010000:1.0:1788830636.493996:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788830636.494000:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7f000/0x575506951eea1783 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661f7c expref: 20 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830636.494011:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e257480c300) 00010000:00010000:1.0:1788830636.494013:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788830636.494016:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944400/0x575506951eea1307 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661e3a expref: 19 pid: 8202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830636.494086:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e25530b0f00) 00010000:00010000:1.0:1788830636.494089:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788830636.494094:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729a00/0x575506951eea19a5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.21@tcp remote: 0xa578910534662008 expref: 18 pid: 8202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830636.494107:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e25530b0b00) 00010000:00010000:1.0:1788830636.494109:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788830636.494112:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944a00/0x575506951eea14a4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661eaa expref: 17 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830636.494126:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e257480c400) 00010000:00010000:1.0:1788830636.494128:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788830636.494131:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea1488 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661ea3 expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830636.494142:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9e25518dca00) 00010000:00010000:1.0:1788830636.494144:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788830636.494148:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7fc00/0x575506951eea0d96 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661cc7 expref: 15 pid: 8202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830636.494162:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e257480c300) 00010000:00010000:1.0:1788830636.494164:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788830636.494168:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7ec00/0x575506951eea13e7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661e72 expref: 14 pid: 8202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830636.494178:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e25530b0f00) 00010000:00010000:1.0:1788830636.494180:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788830636.494191:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6800/0x575506951eea1a85 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.21@tcp remote: 0xa578910534662040 expref: 13 pid: 8202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830636.494204:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e25518dc500) 00010000:00010000:1.0:1788830636.494206:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788830636.494211:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445b7e800/0x575506951eea0e06 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661ce3 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830636.494222:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e25518dc500) 00010000:00010000:1.0:1788830636.494223:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788830636.494226:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d80e200/0x575506951eea0f9c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661d61 expref: 11 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830636.494240:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e25530b0f00) 00010000:00010000:1.0:1788830636.494242:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788830636.494245:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8dc00/0x575506951eea1aaf lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.21@tcp remote: 0xa57891053466204e expref: 10 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830636.494256:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e257480c300) 00010000:00010000:1.0:1788830636.494258:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788830636.494261:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffe00/0x575506951eea1411 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661e80 expref: 9 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830636.494271:0:5821:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e2446c87800, canceled 13 locks, left on hash table 0. 00010000:00010000:1.0:1788830636.494282:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788830636.494284:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788830636.494285:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788830636.494796:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 239 00010000:00010000:1.0:1788830637.083977:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788830637.351131:0:7646:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 1ef2fe7a-e5ec-4085-8326-b72aa00876cd 00000020:00000080:2.0:1788830637.351143:0:7646:0:(genops.c:885:class_export_put()) final put ffff9e2544c04000/1ef2fe7a-e5ec-4085-8326-b72aa00876cd 00000020:00000080:0.0:1788830637.351213:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e2544c04000/1ef2fe7a-e5ec-4085-8326-b72aa00876cd for lustre-OST0001 00000020:00000080:0.0:1788830637.351335:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e2544c04800 for lustre-OST0001 00000100:00100000:2.0:1788830637.788172:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788830637.788197:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257f804e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875724595183232:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788830637.788277:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830637.788332:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595183232 00000100:00100000:1.0:1788830637.788354:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595183232 00000100:00100000:1.0:1788830637.788431:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788830637.788441:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25658c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875724595183232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788830637.788477:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788830637.788523:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25658c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875724595183232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830637.788531:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788830637.788578:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257f804e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875724595183232:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788830637.788659:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:3.0:1788830637.847736:0:6709:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 1ef2fe7a-e5ec-4085-8326-b72aa00876cd 00000020:00000080:3.0:1788830637.847746:0:6709:0:(genops.c:885:class_export_put()) final put ffff9e255179a800/1ef2fe7a-e5ec-4085-8326-b72aa00876cd 00000020:00000080:3.0:1788830637.847777:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e255179a800/1ef2fe7a-e5ec-4085-8326-b72aa00876cd for lustre-OST0000 00000020:00000080:3.0:1788830637.847828:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e2551798000 for lustre-OST0000 00000001:00100000:3.0:1788830637.854977:0:5855:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 1ef2fe7a-e5ec-4085-8326-b72aa00876cd 00000001:00080000:3.0:1788830637.854993:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967523 is committed 00000020:00000080:3.0:1788830637.855009:0:5855:0:(genops.c:885:class_export_put()) final put ffff9e2446c87800/1ef2fe7a-e5ec-4085-8326-b72aa00876cd 00000020:00000080:0.0:1788830637.855144:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9e2446c87800/1ef2fe7a-e5ec-4085-8326-b72aa00876cd for lustre-MDT0000 00000020:00000080:0.0:1788830637.855210:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e2446c81800 for lustre-MDT0000 00000100:00100000:1.0:1788830637.956684:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830637.956786:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830637.956885:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578429184 00000100:00100000:0.0:1788830637.956895:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578429184 00000100:00100000:0.0:1788830637.956964:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578429312 00000100:00100000:0.0:1788830637.956982:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578429312 00000100:00100000:0.0:1788830637.957008:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 22 00000100:00100000:0.0:1788830637.957018:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257f804e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+11:2354:x1875724578429184:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788830637.957036:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788830637.957058:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2565728800/0x575506951eea0b9e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661c03 expref: 11 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830637.957075:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788830637.957140:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257f804e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+10:2354:x1875724578429184:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 122us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830637.957147:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 22 00000100:00100000:0.0:1788830637.957164:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 23 00000100:00100000:0.0:1788830637.957170:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255da68450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+9:2354:x1875724578429312:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788830637.957178:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788830637.957186:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e25820fee00/0x575506951eea0ba5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661c2d expref: 9 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830637.957194:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788830637.957211:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255da68450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+8:2354:x1875724578429312:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 41us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830637.957218:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 23 00000100:00100000:3.0:1788830637.961514:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830637.961606:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578429440 00000100:00100000:0.0:1788830637.961618:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578429440 00000100:00100000:0.0:1788830637.961687:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 24 00000100:00100000:0.0:1788830637.961699:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257fac9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+8:2353:x1875724578429440:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788830637.961763:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788830637.961783:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2445b7fe00/0x575506951eea0d3b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661cb2 expref: 8 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830637.961811:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788830637.961866:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257fac9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+7:2353:x1875724578429440:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 169us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830637.961873:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 24 00000100:00100000:0.0:1788830637.969857:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830637.969965:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578429696 00000100:00100000:3.0:1788830637.969976:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578429696 00000100:00100000:3.0:1788830637.970242:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 240 00000100:00100000:3.0:1788830637.970255:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25654d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2154ea6-69cb-4a30-aac0-000fba13e98b+6:2351:x1875724578429696:12345-192.168.201.21@tcp:39:umount.0 00000020:00000080:3.0:1788830637.970317:0:5834:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x575506951eea0bb3 00000020:00010000:3.0:1788830637.970325:0:5834:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9e257fc9f000: total 0 00000100:00080000:3.0:1788830637.970330:0:5834:0:(import.c:65:import_set_state_nolock()) ffff9e257fc9b800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788830637.970362:0:5834:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967523 00000100:00100000:3.0:1788830637.970826:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25654d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2154ea6-69cb-4a30-aac0-000fba13e98b+5:2351:x1875724578429696:12345-192.168.201.21@tcp:39:umount.0 Request processed in 573us (977us total) trans 4294967524 rc 0/0 00000100:00100000:3.0:1788830637.970848:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 240 00000020:00010000:1.0:1788830637.970918:0:5821:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9e257fc9f000: total 0 00010000:00010000:1.0:1788830637.970959:0:5821:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e257fc9f000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1788830637.971000:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e257480c400) 00010000:00010000:1.0:1788830637.971003:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788830637.971011:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e257d944200/0x575506951eea1ad2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.21@tcp remote: 0xa57891053466205c expref: 4 pid: 8202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830637.971038:0:5821:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e257fc9f000, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1788830637.971049:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788830637.971051:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788830637.971052:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788830637.971997:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788830637.994683:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830637.995062:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578429952 00000100:00100000:3.0:1788830637.995075:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578429952 00000100:00100000:3.0:1788830637.995137:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 299 00000100:00100000:3.0:1788830637.995149:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2574711450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+7:2351:x1875724578429952:12345-192.168.201.21@tcp:251:umount.0 00000020:00000080:3.0:1788830637.995197:0:5826:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x575506951eea0aa9 00000020:00010000:3.0:1788830637.995205:0:5826:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9e25475de000: total 0 00000100:00080000:3.0:1788830637.995210:0:5826:0:(import.c:65:import_set_state_nolock()) ffff9e25475df800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1788830637.995296:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2574711450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee+3:2351:x1875724578429952:12345-192.168.201.21@tcp:251:umount.0 Request processed in 149us (624us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830637.995305:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 299 00000020:00010000:1.0:1788830637.995471:0:5820:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9e25475de000: total 0 00010000:00010000:1.0:1788830637.995476:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788830637.995523:0:5820:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e25475de000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1788830637.995558:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e25820fe200/0x575506951eea0b5f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.201.21@tcp remote: 0xa578910534661bf5 expref: 2 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830637.995592:0:5820:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e25475de000, canceled 1 locks, left on hash table 0. 00000020:00000080:1.0:1788830637.995601:0:5820:0:(genops.c:885:class_export_put()) final put ffff9e25475de000/2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee 00010000:00010000:1.0:1788830637.995621:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788830637.995623:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788830637.995625:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788830637.996208:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e25475de000/2b285a04-2eba-4b4a-bf3b-8a4b31dfa2ee for MGS 00000020:00000080:3.0:1788830637.996249:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e25475df800 for MGS 00010000:00010000:1.0:1788830638.107979:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788830638.812738:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2445d01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875724595183616:0@lo:400:kworker.0 00000100:00100000:0.0:1788830638.812809:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830638.812860:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788830638.812865:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257ffdf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1875724595183744:0@lo:400:kworker.0 00000100:00100000:0.0:1788830638.812889:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830638.812924:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595183616 00000100:00100000:0.0:1788830638.812931:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595183616 00000100:00100000:0.0:1788830638.812971:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788830638.812978:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25478b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875724595183616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788830638.813020:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25478b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875724595183616:12345-0@lo:400:kworker.0 Request processed in 43us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830638.813025:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788830638.813046:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595183744 00000100:00100000:0.0:1788830638.813050:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595183744 00000100:00100000:0.0:1788830638.813100:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788830638.813107:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25478b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875724595183744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788830638.813138:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25478b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875724595183744:12345-0@lo:400:kworker.0 Request processed in 31us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830638.813144:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788830638.813183:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257ffdf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1875724595183744:0@lo:400:kworker.0 00000100:00100000:0.0:1788830638.813206:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2445d01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875724595183616:0@lo:400:kworker.0 00000100:00100000:3.0:1788830638.813365:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e255130a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1745cc3d-3952-4cd4-9020-9b8acb483105:3309:1875724595183360:0@lo:400:kworker.0 00000100:00100000:3.0:1788830638.813407:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830638.813443:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257ffdc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1875724595183872:0@lo:400:kworker.0 00000100:00100000:3.0:1788830638.813465:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830638.813484:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788830638.813490:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2445d00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875724595183488:0@lo:400:kworker.0 00000100:00100000:3.0:1788830638.813511:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830638.813526:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25478b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875724595184000:0@lo:400:kworker.0 00000100:00100000:3.0:1788830638.813549:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830638.813572:0:8202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595183872 00000100:00100000:3.0:1788830638.813575:0:8202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595183872 00000100:00100000:3.0:1788830638.813600:0:8202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788830638.813607:0:8202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257facb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875724595183872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788830638.813652:0:8202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257facb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875724595183872:12345-0@lo:400:kworker.0 Request processed in 45us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830638.813658:0:8202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788830638.813668:0:8202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595183488 00000100:00100000:3.0:1788830638.813671:0:8202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595183488 00000100:00100000:3.0:1788830638.813685:0:8202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788830638.813690:0:8202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25654b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875724595183488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788830638.813739:0:8202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25654b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875724595183488:12345-0@lo:400:kworker.0 Request processed in 48us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830638.813744:0:8202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788830638.813765:0:12010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595184000 00000100:00100000:3.0:1788830638.813768:0:12010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595184000 00000100:00100000:3.0:1788830638.813793:0:12010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788830638.813798:0:12010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2544ee4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1875724595184000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788830638.813829:0:12010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2544ee4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1875724595184000:12345-0@lo:400:kworker.0 Request processed in 30us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830638.813834:0:12010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788830638.813864:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2445d00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875724595183488:0@lo:400:kworker.0 00000100:00100000:3.0:1788830638.813873:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25478b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875724595184000:0@lo:400:kworker.0 00000100:00100000:3.0:1788830638.813882:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257ffdc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1875724595183872:0@lo:400:kworker.0 00000100:00100000:0.0:1788830638.814917:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595183360 00000100:00100000:0.0:1788830638.814927:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595183360 00000100:00100000:0.0:1788830638.814960:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:0.0:1788830638.814968:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255d948c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+19:3309:x1875724595183360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788830638.815027:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255d948c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1745cc3d-3952-4cd4-9020-9b8acb483105+19:3309:x1875724595183360:12345-0@lo:400:kworker.0 Request processed in 59us (1618us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830638.815034:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:0.0:1788830638.815087:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e255130a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1745cc3d-3952-4cd4-9020-9b8acb483105:3309:1875724595183360:0@lo:400:kworker.0 00000100:00080000:2.0:1788830638.815287:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788830638.815292:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788830639.135005:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788830639.329977:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257f804e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875724595184128:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788830639.330063:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788830639.330142:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595184128 00000100:00100000:2.0:1788830639.330149:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595184128 00000100:00100000:2.0:1788830639.330196:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788830639.330204:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25658c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875724595184128:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788830639.330240:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788830639.330283:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25658c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875724595184128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830639.330290:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788830639.330349:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257f804e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875724595184128:0@lo:13:osp-pre-1-0.0 00000020:01000004:2.0:1788830639.661735:0:13067:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1788830639.691042:0:13067:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1788830639.691102:0:13067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.121@tcp lock: ffff9e2565729e00/0x575506951eea0b2e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea0b35 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830639.691119:0:13067:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: ffff9e2565729e00/0x575506951eea0b2e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x575506951eea0b35 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830639.691146:0:13067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: ffff9e2565729e00/0x575506951eea0b2e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x575506951eea0b35 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830639.691154:0:13067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.121@tcp lock: ffff9e2565729e00/0x575506951eea0b2e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x575506951eea0b35 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830639.691179:0:13067:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788830639.691185:0:13067:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788830639.691208:0:13067:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788830639.691212:0:13067:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788830639.691218:0:13067:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788830639.691243:0:13067:0:(import.c:65:import_set_state_nolock()) ffff9e2544819800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:1.0:1788830639.691379:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788830639.691387:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.121@tcp lock: ffff9e2565729e00/0x575506951eea0b2e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x575506951eea0b35 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830639.691396:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2565729e00 already unused, calling callback (ffffffffc1aebc20) 10000000:00010000:1.0:1788830639.691399:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.121@tcp lock: ffff9e2565729e00/0x575506951eea0b2e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x575506951eea0b35 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830639.691409:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.121@tcp lock: ffff9e2565729e00/0x575506951eea0b2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x575506951eea0b35 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788830639.691416:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.121@tcp lock: ffff9e2565729e00/0x575506951eea0b2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x575506951eea0b35 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788830639.691421:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788830639.691424:0:5821:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788830639.691426:0:5821:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788830639.691461:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.121@tcp lock: ffff9e2565729e00/0x575506951eea0b2e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x575506951eea0b35 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830639.691468:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788830639.691498:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.121@tcp lock: ffff9e2565729e00/0x575506951eea0b2e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x575506951eea0b35 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830639.691512:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.121@tcp lock: ffff9e2565729e00/0x575506951eea0b2e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x575506951eea0b35 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830639.691524:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788830639.691526:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788830639.691528:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788830639.691536:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788830639.691553:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257f807b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1745cc3d-3952-4cd4-9020-9b8acb483105:3307:1875724595184384:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788830639.691617:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830639.691678:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595184384 00000100:00100000:1.0:1788830639.691684:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595184384 00000100:00100000:1.0:1788830639.691755:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788830639.691765:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257f807800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1745cc3d-3952-4cd4-9020-9b8acb483105+19:3307:x1875724595184384:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788830639.691779:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788830639.691796:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e257d945800/0x575506951eea0b35 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x575506951eea0b2e expref: 19 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830639.691809:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788830639.691843:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257f807800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1745cc3d-3952-4cd4-9020-9b8acb483105+18:3307:x1875724595184384:12345-0@lo:103:ldlm_bl.0 Request processed in 79us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830639.691851:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788830639.691892:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257f807b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1745cc3d-3952-4cd4-9020-9b8acb483105:3307:1875724595184384:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788830639.692038:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25747c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875724595184256:0@lo:39:umount.0 00000100:00100000:2.0:1788830639.692072:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830639.692180:0:8202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595184256 00000100:00100000:1.0:1788830639.692185:0:8202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595184256 00000100:00100000:1.0:1788830639.692218:0:8202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1788830639.692225:0:8202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25658c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875724595184256:12345-0@lo:39:umount.0 00000020:00000080:1.0:1788830639.692257:0:8202:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x575506951eea08b8 00000100:00080000:1.0:1788830639.692267:0:8202:0:(import.c:65:import_set_state_nolock()) ffff9e2544f0f000 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1788830639.692330:0:8202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25658c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+1:3306:x1875724595184256:12345-0@lo:39:umount.0 Request processed in 104us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830639.692337:0:8202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000020:00000080:1.0:1788830639.692343:0:8202:0:(genops.c:885:class_export_put()) final put ffff9e255f8b5000/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00080000:1.0:1788830639.692390:0:3306:0:(import.c:65:import_set_state_nolock()) ffff9e2544819800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788830639.692399:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25747c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875724595184256:0@lo:39:umount.0 00010000:00010000:2.0:1788830639.692445:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788830639.692528:0:13067:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788830639.692531:0:13067:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788830639.692535:0:13067:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788830639.693402:0:13067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.121@tcp lock: ffff9e25820fea00/0x575506951eea0b3c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea0b43 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830639.693419:0:13067:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: ffff9e25820fea00/0x575506951eea0b3c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x575506951eea0b43 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830639.693426:0:13067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: ffff9e25820fea00/0x575506951eea0b3c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x575506951eea0b43 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830639.693432:0:13067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.121@tcp lock: ffff9e25820fea00/0x575506951eea0b3c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x575506951eea0b43 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1788830639.693566:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9e255f8b5000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1788830639.693631:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e2544f0f000 for lustre-MDT0000 00010000:00010000:3.0:1788830639.693763:0:13067:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788830639.693782:0:13067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.121@tcp lock: ffff9e257d80fc00/0x575506951eea0a9b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea0aa2 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830639.693790:0:13067:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: ffff9e257d80fc00/0x575506951eea0a9b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x575506951eea0aa2 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830639.693796:0:13067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: ffff9e257d80fc00/0x575506951eea0a9b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x575506951eea0aa2 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830639.693802:0:13067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.121@tcp lock: ffff9e257d80fc00/0x575506951eea0a9b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x575506951eea0aa2 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830639.693941:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788830639.693948:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.121@tcp lock: ffff9e25820fea00/0x575506951eea0b3c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x575506951eea0b43 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830639.693954:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e25820fea00 already unused, calling callback (ffffffffc1aebc20) 10000000:00010000:1.0:1788830639.693958:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.121@tcp lock: ffff9e25820fea00/0x575506951eea0b3c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x575506951eea0b43 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830639.693967:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.121@tcp lock: ffff9e25820fea00/0x575506951eea0b3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x575506951eea0b43 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788830639.693975:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.121@tcp lock: ffff9e25820fea00/0x575506951eea0b3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x575506951eea0b43 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788830639.693980:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788830639.693983:0:5821:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:1.0:1788830639.694014:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.121@tcp lock: ffff9e25820fea00/0x575506951eea0b3c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x575506951eea0b43 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830639.694031:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788830639.694060:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.121@tcp lock: ffff9e25820fea00/0x575506951eea0b3c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x575506951eea0b43 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830639.694067:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.121@tcp lock: ffff9e25820fea00/0x575506951eea0b3c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x575506951eea0b43 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830639.694079:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788830639.694083:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.121@tcp lock: ffff9e257d80fc00/0x575506951eea0a9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x575506951eea0aa2 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830639.694088:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e257d80fc00 already unused, calling callback (ffffffffc1aebc20) 10000000:00010000:1.0:1788830639.694091:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.121@tcp lock: ffff9e257d80fc00/0x575506951eea0a9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x575506951eea0aa2 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830639.694097:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.121@tcp lock: ffff9e257d80fc00/0x575506951eea0a9b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x575506951eea0aa2 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788830639.694103:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.121@tcp lock: ffff9e257d80fc00/0x575506951eea0a9b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x575506951eea0aa2 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788830639.694108:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1788830639.694110:0:5821:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:1.0:1788830639.694122:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.121@tcp lock: ffff9e257d80fc00/0x575506951eea0a9b lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x575506951eea0aa2 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830639.694128:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788830639.694134:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.121@tcp lock: ffff9e257d80fc00/0x575506951eea0a9b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x575506951eea0aa2 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830639.694150:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788830639.694152:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788830639.694154:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788830639.694194:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257f804e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1745cc3d-3952-4cd4-9020-9b8acb483105:3310:1875724595184640:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788830639.694252:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788830639.694301:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788830639.694307:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257f807b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1745cc3d-3952-4cd4-9020-9b8acb483105:3310:1875724595184512:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788830639.694327:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830639.694423:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595184640 00000100:00100000:1.0:1788830639.694431:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595184640 00000100:00100000:1.0:1788830639.694485:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595184512 00000100:00100000:1.0:1788830639.694488:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595184512 00000100:00100000:1.0:1788830639.694548:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788830639.694557:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25658c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1745cc3d-3952-4cd4-9020-9b8acb483105+19:3310:x1875724595184640:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788830639.694570:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788830639.694585:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2445b7f200/0x575506951eea0aa2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x575506951eea0a9b expref: 19 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830639.694599:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788830639.694637:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25658c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1745cc3d-3952-4cd4-9020-9b8acb483105+18:3310:x1875724595184640:12345-0@lo:103:ldlm_bl.0 Request processed in 80us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830639.694643:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788830639.694659:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788830639.694665:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25658c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1745cc3d-3952-4cd4-9020-9b8acb483105+17:3310:x1875724595184512:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788830639.694673:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788830639.694681:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2445b7f400/0x575506951eea0b43 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x575506951eea0b3c expref: 17 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830639.694688:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788830639.694737:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25658c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1745cc3d-3952-4cd4-9020-9b8acb483105+16:3310:x1875724595184512:12345-0@lo:103:ldlm_bl.0 Request processed in 44us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830639.694743:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:3.0:1788830639.694963:0:13067:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788830639.694969:0:13067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.121@tcp lock: ffff9e257d80fc00/0x575506951eea0a9b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x575506951eea0aa2 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788830639.694983:0:13067:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00000100:00100000:1.0:1788830639.696014:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257f807b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1745cc3d-3952-4cd4-9020-9b8acb483105:3310:1875724595184512:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788830639.696024:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257f804e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1745cc3d-3952-4cd4-9020-9b8acb483105:3310:1875724595184640:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788830639.696257:0:13067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.121@tcp lock: ffff9e2540030600/0x575506951eea0d65 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea0d6c expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830639.696271:0:13067:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: ffff9e2540030600/0x575506951eea0d65 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x575506951eea0d6c expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830639.696277:0:13067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: ffff9e2540030600/0x575506951eea0d65 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x575506951eea0d6c expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830639.696283:0:13067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.121@tcp lock: ffff9e2540030600/0x575506951eea0d65 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x575506951eea0d6c expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830639.696306:0:13067:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788830639.696312:0:13067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.121@tcp lock: ffff9e2540030200/0x575506951eea0817 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea081e expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830639.696319:0:13067:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: ffff9e2540030200/0x575506951eea0817 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x575506951eea081e expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830639.696339:0:13067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: ffff9e2540030200/0x575506951eea0817 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x575506951eea081e expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830639.696344:0:13067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.121@tcp lock: ffff9e2540030200/0x575506951eea0817 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x575506951eea081e expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830639.696351:0:13067:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1788830639.696364:0:13067:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:2.0:1788830639.696368:0:13067:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:2.0:1788830639.696397:0:13067:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1788830639.696401:0:13067:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:2.0:1788830639.696405:0:13067:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788830639.696411:0:13067:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/7 00000020:00080000:2.0:1788830639.696416:0:13067:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9e2444ade000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788830639.696422:0:13067:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9e2444b5d000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788830639.696429:0:13067:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff9e257fc9f000 c2154ea6-69cb-4a30-aac0-000fba13e98b 192.168.201.21@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788830639.696434:0:13067:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff9e2547ae19b8) has exports, disconnecting them 00000020:00080000:2.0:1788830639.696438:0:13067:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9e2444ade000), last request at 1788830638 00010000:00010000:3.0:1788830639.696518:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788830639.696525:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.121@tcp lock: ffff9e2540030600/0x575506951eea0d65 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x575506951eea0d6c expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830639.696532:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2540030600 already unused, calling callback (ffffffffc1aebc20) 10000000:00010000:3.0:1788830639.696536:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.121@tcp lock: ffff9e2540030600/0x575506951eea0d65 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x575506951eea0d6c expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830639.696544:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.121@tcp lock: ffff9e2540030600/0x575506951eea0d65 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x575506951eea0d6c expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788830639.696551:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.121@tcp lock: ffff9e2540030600/0x575506951eea0d65 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x575506951eea0d6c expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788830639.696568:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788830639.696570:0:5820:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1788830639.696572:0:5820:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788830639.696601:0:5820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.121@tcp lock: ffff9e2540030600/0x575506951eea0d65 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x575506951eea0d6c expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830639.696607:0:5820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788830639.696629:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.121@tcp lock: ffff9e2540030600/0x575506951eea0d65 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x575506951eea0d6c expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830639.696636:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.121@tcp lock: ffff9e2540030600/0x575506951eea0d65 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x575506951eea0d6c expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830639.696648:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788830639.696651:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.121@tcp lock: ffff9e2540030200/0x575506951eea0817 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x575506951eea081e expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830639.696657:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2540030200 already unused, calling callback (ffffffffc1aebc20) 10000000:00010000:3.0:1788830639.696660:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.121@tcp lock: ffff9e2540030200/0x575506951eea0817 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x575506951eea081e expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830639.696666:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.121@tcp lock: ffff9e2540030200/0x575506951eea0817 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x575506951eea081e expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788830639.696673:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.121@tcp lock: ffff9e2540030200/0x575506951eea0817 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x575506951eea081e expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788830639.696678:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1788830639.696680:0:5820:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1788830639.696682:0:5820:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1788830639.696701:0:5820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.121@tcp lock: ffff9e2540030200/0x575506951eea0817 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x575506951eea081e expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830639.696729:0:5820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788830639.696736:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.121@tcp lock: ffff9e2540030200/0x575506951eea0817 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x575506951eea081e expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830639.696743:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.121@tcp lock: ffff9e2540030200/0x575506951eea0817 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x575506951eea081e expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830639.696755:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788830639.696757:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788830639.696758:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788830639.696771:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25747c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1745cc3d-3952-4cd4-9020-9b8acb483105:3308:1875724595184896:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788830639.696820:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830639.696860:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788830639.696866:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25747c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1745cc3d-3952-4cd4-9020-9b8acb483105:3308:1875724595184768:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788830639.696888:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830639.696914:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595184896 00000100:00100000:3.0:1788830639.696920:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595184896 00000100:00100000:3.0:1788830639.696958:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595184768 00000100:00100000:3.0:1788830639.696961:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595184768 00000100:00100000:3.0:1788830639.696980:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788830639.696989:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25747c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1745cc3d-3952-4cd4-9020-9b8acb483105+17:3308:x1875724595184896:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788830639.697001:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788830639.697015:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e257d80f200/0x575506951eea081e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x575506951eea0817 expref: 17 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830639.697028:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788830639.697058:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25747c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1745cc3d-3952-4cd4-9020-9b8acb483105+16:3308:x1875724595184896:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830639.697072:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788830639.697088:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788830639.697094:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25747c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1745cc3d-3952-4cd4-9020-9b8acb483105+15:3308:x1875724595184768:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788830639.697102:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788830639.697111:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2540031e00/0x575506951eea0d6c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x575506951eea0d65 expref: 15 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830639.697122:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788830639.697143:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25747c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1745cc3d-3952-4cd4-9020-9b8acb483105+14:3308:x1875724595184768:12345-0@lo:103:ldlm_bl.0 Request processed in 49us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830639.697149:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788830639.697174:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25747c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1745cc3d-3952-4cd4-9020-9b8acb483105:3308:1875724595184768:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788830639.697182:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25747c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1745cc3d-3952-4cd4-9020-9b8acb483105:3308:1875724595184896:0@lo:103:ldlm_bl.0 00000020:00000080:2.0:1788830639.697251:0:13067:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x575506951eea0a2b 00000100:00080000:2.0:1788830639.697268:0:13067:0:(import.c:65:import_set_state_nolock()) ffff9e2444add800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788830639.697316:0:13067:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e2444ade000): rc 0 00000020:00000080:2.0:1788830639.697318:0:13067:0:(genops.c:885:class_export_put()) final put ffff9e2444ade000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:2.0:1788830639.697332:0:13067:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9e2444b5d000), last request at 1788830638 00000020:00000080:2.0:1788830639.697335:0:13067:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x575506951eea099f 00000100:00080000:2.0:1788830639.697340:0:13067:0:(import.c:65:import_set_state_nolock()) ffff9e2444b5a800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788830639.697345:0:13067:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e2444b5d000): rc 0 00000020:00000080:2.0:1788830639.697347:0:13067:0:(genops.c:885:class_export_put()) final put ffff9e2444b5d000/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:2.0:1788830639.697376:0:13067:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb658c180fae0 00000100:00080000:2.0:1788830639.697397:0:13067:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788830639.697400:0:13067:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:2.0:1788830639.697410:0:13067:0:(osp_dev.c:1634:osp_import_event()) got inactive 00010000:00010000:1.0:1788830639.697554:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788830639.697613:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e2444ade000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1788830639.697664:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e2444b5d000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1788830639.697686:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e2444add800 for lustre-MDT0000 00000020:00000080:0.0:1788830639.697691:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e2444b5a800 for lustre-MDT0000 00000100:00080000:2.0:1788830639.697831:0:13067:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1788830639.697847:0:13067:0:(import.c:65:import_set_state_nolock()) ffff9e2444adf000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1788830639.697889:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25658c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1875724595185024:0@lo:9:umount.0 00000100:00100000:1.0:1788830639.697927:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788830639.697969:0:13067:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788830639.697972:0:13067:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:2.0:1788830639.697982:0:13067:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1788830639.698036:0:13067:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1788830639.698047:0:13067:0:(import.c:65:import_set_state_nolock()) ffff9e2550066800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00010000:00010000:3.0:1788830639.698101:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788830639.698138:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595185024 00000100:00100000:0.0:1788830639.698143:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595185024 00000100:00100000:0.0:1788830639.698191:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788830639.698199:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257f804e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875724595185024:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788830639.698218:0:6677:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x575506951eea09ad 00000100:00080000:0.0:1788830639.698224:0:6677:0:(import.c:65:import_set_state_nolock()) ffff9e2444ad9000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788830639.698250:0:6677:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00080000:3.0:1788830639.698608:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788830639.698745:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25658c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1875724595185152:0@lo:9:umount.0 00000100:00100000:1.0:1788830639.698771:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830639.698824:0:12010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595185152 00000100:00100000:3.0:1788830639.698829:0:12010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595185152 00000100:00100000:3.0:1788830639.698852:0:12010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788830639.698859:0:12010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257f807b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1875724595185152:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788830639.698872:0:12010:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x575506951eea0a94 00000100:00080000:3.0:1788830639.698877:0:12010:0:(import.c:65:import_set_state_nolock()) ffff9e2446c83800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788830639.698896:0:12010:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:3.0:1788830639.699101:0:12010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257f807b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3306:x1875724595185152:12345-0@lo:9:umount.0 Request processed in 241us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830639.699107:0:12010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00010000:00010000:3.0:1788830639.699127:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1788830639.699209:0:13067:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9e2547ae19b8) has no exports 00000100:00100000:0.0:1788830639.699316:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257f804e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3306:x1875724595185024:12345-0@lo:9:umount.0 Request processed in 1118us (1387us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830639.699323:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00010000:00010000:0.0:1788830639.699340:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788830639.700008:0:3306:0:(import.c:65:import_set_state_nolock()) ffff9e2444adf000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788830639.700055:0:3306:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788830639.700151:0:3306:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788830639.700157:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25658c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1875724595185024:0@lo:9:umount.0 00000100:00080000:1.0:1788830639.700187:0:3306:0:(import.c:65:import_set_state_nolock()) ffff9e2550066800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788830639.700191:0:3306:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788830639.700192:0:3306:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788830639.700194:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25658c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1875724595185152:0@lo:9:umount.0 00000020:00080000:2.0:1788830639.707100:0:13067:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9e2547ae19b8) has no exports 00000020:00000080:2.0:1788830639.746836:0:13067:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x575506951eea0872 00000020:00000080:2.0:1788830639.746853:0:13067:0:(genops.c:885:class_export_put()) final put ffff9e257e96b000/lustre-QMT0000_UUID 00000020:01000000:2.0:1788830639.746874:0:13067:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:1.0:1788830639.746903:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9e257e96b000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:3.0:1788830639.747002:0:13067:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788830639.747012:0:13067:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788830639.747017:0:13067:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff9e256601b370) has no exports 00000020:00000080:0.0:1788830639.747301:0:13067:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x575506951eea086b 00000020:00000080:0.0:1788830639.747306:0:13067:0:(genops.c:885:class_export_put()) final put ffff9e255f8b2000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788830639.747346:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9e255f8b2000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788830639.747380:0:13067:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788830639.747386:0:13067:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1788830639.747388:0:13067:0:(genops.c:885:class_export_put()) final put ffff9e2566022800/lustre-QMT0000_UUID 00000020:00000080:0.0:1788830639.747390:0:13067:0:(genops.c:844:class_export_destroy()) destroying export ffff9e2566022800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1788830639.747396:0:13067:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00010000:00010000:3.0:1788830640.155874:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788830641.183818:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788830642.203956:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788830642.472385:0:7646:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788830642.472396:0:7646:0:(genops.c:885:class_export_put()) final put ffff9e2446c87000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788830642.472562:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e2446c87000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1788830642.472618:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e2446c83800 for lustre-OST0001 00000001:00100000:3.0:1788830642.973381:0:5855:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of c2154ea6-69cb-4a30-aac0-000fba13e98b 00000001:00080000:3.0:1788830642.973397:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967524 is committed 00000020:00000080:3.0:1788830642.973402:0:5855:0:(genops.c:885:class_export_put()) final put ffff9e257fc9f000/c2154ea6-69cb-4a30-aac0-000fba13e98b 00000001:00100000:2.0:1788830642.975141:0:6709:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788830642.975152:0:6709:0:(genops.c:885:class_export_put()) final put ffff9e2444ad8800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788830642.975514:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9e257fc9f000/c2154ea6-69cb-4a30-aac0-000fba13e98b for lustre-MDT0000 00000020:00000080:0.0:1788830642.975576:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9e2444ad8800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1788830642.975593:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e257fc9b800 for lustre-MDT0000 00000020:00000080:0.0:1788830642.975597:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e2444ad9000 for lustre-OST0000 00010000:00010000:0.0:1788830643.227828:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788830643.932178:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25747c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1745cc3d-3952-4cd4-9020-9b8acb483105:3309:1875724595185280:0@lo:400:kworker.0 00000100:00100000:0.0:1788830643.932263:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830643.932442:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595185280 00000100:00100000:1.0:1788830643.932451:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595185280 00000100:00100000:1.0:1788830643.932502:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:1.0:1788830643.932510:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255d94b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1745cc3d-3952-4cd4-9020-9b8acb483105+14:3309:x1875724595185280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788830643.932848:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25747c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1875724595185408:0@lo:400:kworker.0 00000100:00100000:2.0:1788830643.932883:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788830643.932943:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595185408 00000100:00100000:2.0:1788830643.932948:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595185408 00000100:00100000:2.0:1788830643.932975:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1788830643.932987:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25658c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3310:x1875724595185408:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1788830643.932997:0:5832:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788830643.933034:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25658c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3310:x1875724595185408:12345-0@lo:400:kworker.0 Request processed in 51us (150us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788830643.933055:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00080000:2.0:1788830643.933095:0:3310:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788830643.933100:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9e257fd60800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788830643.933104:0:3310:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:3.0:1788830643.934139:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2545cbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1875724595185536:0@lo:400:kworker.0 00000100:00100000:3.0:1788830643.934178:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830643.934295:0:8202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595185536 00000100:00100000:0.0:1788830643.934302:0:8202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595185536 00000100:00100000:0.0:1788830643.934337:0:8202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1788830643.934344:0:8202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2545cbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3307:x1875724595185536:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1788830643.934350:0:8202:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1788830643.934384:0:8202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2545cbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3307:x1875724595185536:12345-0@lo:400:kworker.0 Request processed in 39us (205us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788830643.934390:0:8202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00080000:0.0:1788830643.934431:0:3307:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788830643.934435:0:3307:0:(import.c:65:import_set_state_nolock()) ffff9e2445b74000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1788830643.934438:0:3307:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1788830643.934443:0:3307:0:(import.c:65:import_set_state_nolock()) ffff9e2445b74000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788830643.934456:0:3307:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 217 00000100:00080000:0.0:1788830643.934463:0:3307:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9e2445b74000 using connection 192.168.201.121@tcp/0@lo 00000100:00100000:0.0:1788830643.934491:0:3307:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e25478b4000 x1875724595185664/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788830643.934510:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2545cbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1875724595185536:0@lo:400:kworker.0 00000100:00100000:0.0:1788830643.934545:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25478b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3306:1875724595185664:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1788830643.934571:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830643.935448:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595185664 00000100:00100000:3.0:1788830643.935456:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595185664 00000100:00100000:3.0:1788830643.935493:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1788830643.935500:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255130a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3306:x1875724595185664:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:3.0:1788830643.935516:0:5834:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1788830643.935683:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255d94b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1745cc3d-3952-4cd4-9020-9b8acb483105+14:3309:x1875724595185280:12345-0@lo:400:kworker.0 Request processed in 3172us (3417us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830643.935692:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:1.0:1788830643.935761:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25747c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1745cc3d-3952-4cd4-9020-9b8acb483105:3309:1875724595185280:0@lo:400:kworker.0 00000100:00100000:3.0:1788830643.959382:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255130a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3306:x1875724595185664:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 23873us (24802us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788830643.959398:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00080000:0.0:1788830643.959482:0:3306:0:(import.c:65:import_set_state_nolock()) ffff9e2445b74000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788830643.959488:0:3306:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788830643.959493:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25478b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3306:1875724595185664:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:2.0:1788830643.960007:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9e257fd60800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788830643.960014:0:3310:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 201 00000100:00080000:2.0:1788830643.960022:0:3310:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9e257fd60800 using connection 192.168.201.121@tcp/0@lo 00000100:00100000:0.0:1788830643.961551:0:3310:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e25478b4000 x1875724595185792/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788830643.961651:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25478b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3306:1875724595185792:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1788830643.961734:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830643.961815:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25747c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1875724595185408:0@lo:400:kworker.0 00000100:00100000:2.0:1788830643.961963:0:8202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595185792 00000100:00100000:2.0:1788830643.961971:0:8202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595185792 00000100:00100000:2.0:1788830643.962017:0:8202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1788830643.962025:0:8202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25747c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3306:x1875724595185792:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:2.0:1788830643.962049:0:8202:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1788830643.962098:0:8202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25747c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3306:x1875724595185792:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 74us (364us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788830643.962105:0:8202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00080000:1.0:1788830643.962144:0:3306:0:(import.c:65:import_set_state_nolock()) ffff9e257fd60800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788830643.962149:0:3306:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788830643.962153:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25478b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3306:1875724595185792:0@lo:38:ptlrpcd_00_03.0 00010000:00010000:3.0:1788830644.251898:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788830645.275966:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1788830645.787890:0:13067:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9e25474d7720 - data ffff9e2444df4bd0/ffff9e2565b35400 00000020:01000000:0.0:1788830645.788037:0:13067:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9e2547884360 - data ffff9e254683cd80/ffff9e2548014c00 00000001:00000004:0.0:1788830645.799005:0:13067:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000100:00080000:0.0:1788830645.852610:0:13067:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788830645.852620:0:13067:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:0.0:1788830645.852983:0:13067:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788830645.852987:0:13067:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788830645.853625:0:6696:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788830645.853630:0:6696:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:1.0:1788830645.853639:0:6696:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:0.0:1788830645.854621:0:13067:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788830645.854626:0:13067:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:0.0:1788830645.854645:0:13067:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788830645.854647:0:13067:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1788830645.854974:0:7643:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1788830645.854978:0:7643:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:3.0:1788830645.854985:0:7643:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:1.0:1788830645.907862:0:13067:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x575506951eea083a 00000020:00000080:1.0:1788830645.907875:0:13067:0:(genops.c:885:class_export_put()) final put ffff9e25707b5000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788830645.908652:0:13067:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x575506951eea084f 00000020:00000080:1.0:1788830645.908659:0:13067:0:(genops.c:885:class_export_put()) final put ffff9e2566024000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788830645.908819:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e25707b5000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1788830645.908873:0:13067:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1788830645.908879:0:13067:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788830645.908887:0:13067:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788830645.908891:0:13067:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff9e2547ae4d28) has no exports 00000004:01000000:1.0:1788830645.909038:0:13067:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1788830645.909046:0:13067:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x575506951eea0a78 00000020:00000080:1.0:1788830645.909050:0:13067:0:(genops.c:885:class_export_put()) final put ffff9e2444adc000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788830645.909054:0:13067:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1788830645.909057:0:13067:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788830645.909062:0:13067:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788830645.909064:0:13067:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff9e2544834d28) has no exports 00000020:00000080:1.0:1788830645.909069:0:13067:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x575506951eea0a71 00000020:00000080:1.0:1788830645.909072:0:13067:0:(genops.c:885:class_export_put()) final put ffff9e2550062000/lustre-MDT0000-osd_UUID 00010000:01000000:1.0:1788830645.909598:0:13067:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1788830645.909602:0:13067:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788830645.909606:0:13067:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:1.0:1788830645.909612:0:13067:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788830645.909625:0:13067:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788830645.909654:0:13067:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788830645.909660:0:13067:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788830645.909666:0:13067:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x575506951eea0944 00000020:00000080:1.0:1788830645.909670:0:13067:0:(genops.c:885:class_export_put()) final put ffff9e2550067000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788830645.909674:0:13067:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1788830645.909677:0:13067:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788830645.909680:0:13067:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788830645.909682:0:13067:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9e2544828000) has no exports 00000020:00000080:1.0:1788830645.909685:0:13067:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x575506951eea0913 00000020:00000080:1.0:1788830645.909688:0:13067:0:(genops.c:885:class_export_put()) final put ffff9e2444ade800/lustre-MDT0000-osd_UUID 00010000:01000000:1.0:1788830645.910013:0:13067:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1788830645.910016:0:13067:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788830645.910019:0:13067:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:1.0:1788830645.910022:0:13067:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788830645.910024:0:13067:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788830645.910050:0:13067:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788830645.910054:0:13067:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788830645.910075:0:13067:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788830645.910078:0:13067:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788830645.910112:0:13067:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x575506951eea0856 00000020:00000080:1.0:1788830645.910117:0:13067:0:(genops.c:885:class_export_put()) final put ffff9e2566022000/lustre-MDD0000_UUID 00000020:01000000:1.0:1788830645.910120:0:13067:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:3.0:1788830645.910220:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e2566024000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:3.0:1788830645.910226:0:36:0:(genops.c:885:class_export_put()) final put ffff9e25707b7800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788830645.910228:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e25707b7800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1788830645.910233:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788830645.910379:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e2444adc000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1788830645.910384:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e2550062000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788830645.910395:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e2550066800 for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1788830645.910399:0:36:0:(genops.c:885:class_export_put()) final put ffff9e2444adf800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788830645.910401:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e2444adf800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:3.0:1788830645.910404:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788830645.910427:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e2550067000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1788830645.910431:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e2444ade800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788830645.910435:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e2444adf000 for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1788830645.910438:0:36:0:(genops.c:885:class_export_put()) final put ffff9e257f0da800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788830645.910439:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e257f0da800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:3.0:1788830645.910442:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788830645.910494:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e2566022000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1788830645.910627:0:13067:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788830645.910631:0:13067:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788830645.910634:0:13067:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff9e25660199b8) has no exports 00000020:00000080:1.0:1788830645.910653:0:13067:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788830645.910657:0:13067:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:1.0:1788830645.910659:0:13067:0:(genops.c:885:class_export_put()) final put ffff9e25707b6000/lustre-MDD0000_UUID 00000020:00000080:1.0:1788830645.910662:0:13067:0:(genops.c:844:class_export_destroy()) destroying export ffff9e25707b6000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1788830645.910668:0:13067:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1788830645.910941:0:13067:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x575506951eea085d 00000020:00000080:1.0:1788830645.910951:0:13067:0:(genops.c:885:class_export_put()) final put ffff9e2566026000/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1788830645.910969:0:13067:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e255d9b0800 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1788830645.910972:0:13067:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e255d9b0800 3 00000020:01000004:1.0:1788830645.910975:0:13067:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9e255d9b0800 from lustre-MDT0000 00000020:00000080:1.0:1788830645.910995:0:13067:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788830645.910999:0:13067:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1788830645.911002:0:13067:0:(genops.c:885:class_export_put()) final put ffff9e25707b2800/lustre-MDT0000_UUID 00000020:00000080:1.0:1788830645.911003:0:13067:0:(genops.c:844:class_export_destroy()) destroying export ffff9e25707b2800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1788830645.911012:0:13067:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:1.0:1788830645.911036:0:13067:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:1.0:1788830645.911040:0:13067:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1788830645.911042:0:13067:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1788830645.911045:0:13067:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788830645.911048:0:13067:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788830645.911054:0:13067:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff9e254481f800 1745cc3d-3952-4cd4-9020-9b8acb483105 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788830645.911059:0:13067:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff9e2547ae0000) has exports, disconnecting them 00000020:00080000:1.0:1788830645.911063:0:13067:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9e254481f800), last request at 1788830432 00000020:00000080:1.0:1788830645.911077:0:13067:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x575506951eea07fb 00000020:00010000:1.0:1788830645.911081:0:13067:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9e254481f800: total 1 00000100:00080000:1.0:1788830645.911085:0:13067:0:(import.c:65:import_set_state_nolock()) ffff9e254481a800 : changing import state from FULL to CLOSED 00000020:00000080:3.0:1788830645.911261:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e2566026000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00080000:1.0:1788830645.911328:0:13067:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e254481f800): rc 0 00000020:00080000:1.0:1788830645.911333:0:13067:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff9e2547ae0000) has no exports 00000100:00100000:1.0:1788830645.911399:0:5827:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9e2547558e00:5827] 2 exiting: rc = 0 00000100:00100000:3.0:1788830645.911548:0:5826:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9e2547533200:5826] 1 exiting: rc = 0 00000100:00100000:3.0:1788830645.911767:0:5824:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9e2547558200:5824] 0 exiting: rc = 1 00000100:00100000:1.0:1788830645.911860:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830645.911869:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830645.911875:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830645.911881:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830645.911887:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830645.911893:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830645.911898:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830645.911904:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830645.911910:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830645.911925:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830645.911932:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830645.911939:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830645.911945:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830645.911951:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830645.911956:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830645.911962:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830645.911968:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830645.911974:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830645.911979:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830645.911985:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830645.911990:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830645.911997:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830645.912002:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830645.912007:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830645.912012:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830645.912017:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830645.912023:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830645.912028:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830645.912034:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830645.912039:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830645.912044:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830645.912049:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830645.912054:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830645.912059:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830645.912064:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830645.912070:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830645.912075:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830645.912080:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830645.912084:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830645.912089:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830645.912094:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830645.912113:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830645.912119:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830645.912845:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830645.912861:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830645.912866:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830645.912871:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830645.912878:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830645.912882:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830645.912888:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830645.912894:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830645.912899:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830645.912904:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830645.912908:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830645.912915:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830645.912922:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830645.912927:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830645.912933:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830645.912939:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830645.912943:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830645.912949:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830645.912954:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830645.912961:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830645.912966:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:1.0:1788830645.913632:0:13067:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788830645.913636:0:13067:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:00010000:0.0:1788830645.914273:0:5820:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9e254481f800: total 0 00010000:00010000:0.0:1788830645.914318:0:5820:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e254481f800, canceled 0 locks, left on hash table 8. 00010000:00010000:0.0:1788830645.914352:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2540030000/0x575506951eea092f lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x575506951eea0928 expref: 9 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830645.914373:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2565728000/0x575506951eea0d49 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x575506951eea0d42 expref: 8 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830645.914385:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2565728600/0x575506951eea0afd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x575506951eea0af6 expref: 7 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830645.914395:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2565729c00/0x575506951eea0b0b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x575506951eea0b04 expref: 6 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830645.914405:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2565728200/0x575506951eea0b19 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x575506951eea0b12 expref: 5 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830645.914415:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2445b7e600/0x575506951eea0b27 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x575506951eea0b20 expref: 4 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830645.914426:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2540031c00/0x575506951eea0d5e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x575506951eea0d57 expref: 3 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830645.914440:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e25820fe600/0x575506951eea0b51 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x575506951eea0b4a expref: 2 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830645.914450:0:5820:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e254481f800, canceled 8 locks, left on hash table 0. 00000020:00000080:0.0:1788830645.914462:0:5820:0:(genops.c:885:class_export_put()) final put ffff9e254481f800/1745cc3d-3952-4cd4-9020-9b8acb483105 00010000:00010000:0.0:1788830645.914485:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788830645.914487:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788830645.914489:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788830645.914537:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e254481f800/1745cc3d-3952-4cd4-9020-9b8acb483105 for MGS 00000020:00000080:1.0:1788830645.914573:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e254481a800 for MGS 00000020:01000000:1.0:1788830645.915308:0:13067:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9e2445984c00 - data ffff9e25727fb000/ffff9e256575e800 00000020:01000000:1.0:1788830645.915424:0:13067:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9e255321eea0 - data ffff9e25727af360/ffff9e255d947000 00000020:00000080:1.0:1788830645.915959:0:13067:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x575506951eea07df 00000020:00000080:1.0:1788830645.915966:0:13067:0:(genops.c:885:class_export_put()) final put ffff9e2548336000/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1788830645.916011:0:13067:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e255d9b0800 from MGS, refs=2 00000020:01000004:1.0:1788830645.916015:0:13067:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e255d9b0800 2 00000020:01000004:1.0:1788830645.916018:0:13067:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9e255d9b0800 from MGS 00000020:00000080:1.0:1788830645.916038:0:13067:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788830645.916044:0:13067:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1788830645.916047:0:13067:0:(genops.c:885:class_export_put()) final put ffff9e255d9b6000/MGS 00000020:00000080:1.0:1788830645.916056:0:13067:0:(genops.c:844:class_export_destroy()) destroying export ffff9e255d9b6000/MGS for MGS 00000020:01000000:1.0:1788830645.916061:0:13067:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1788830645.916121:0:13067:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1788830645.916130:0:13067:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788830645.916135:0:13067:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788830645.916142:0:13067:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9e257e969800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788830645.916148:0:13067:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff9e2544833370) has exports, disconnecting them 00000020:00080000:1.0:1788830645.916152:0:13067:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9e257e969800), last request at 1788830433 00000020:00000080:1.0:1788830645.916157:0:13067:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x575506951eea08aa 00000020:00080000:1.0:1788830645.916165:0:13067:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e257e969800): rc 0 00000020:00000080:1.0:1788830645.916169:0:13067:0:(genops.c:885:class_export_put()) final put ffff9e257e969800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1788830645.916407:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9e2548336000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788830645.916781:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9e257e969800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1788830645.924439:0:13067:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1788830645.924448:0:13067:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788830645.924453:0:13067:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788830645.924462:0:13067:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788830645.924674:0:13067:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788830645.924683:0:13067:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1788830645.924691:0:13067:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e255d9b0800 1 00000020:00000080:0.0:1788830645.924697:0:13067:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x575506951eea07d1 00000020:00000080:0.0:1788830645.924705:0:13067:0:(genops.c:885:class_export_put()) final put ffff9e255d9b1800/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1788830645.924729:0:13067:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1788830645.924734:0:13067:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788830645.924738:0:13067:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788830645.924741:0:13067:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff9e2547ae3370) has no exports 00000020:00000080:3.0:1788830645.925295:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e2544819800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1788830645.925304:0:8:0:(genops.c:885:class_export_put()) final put ffff9e25707d1000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1788830645.925307:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9e25707d1000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:3.0:1788830645.925313:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:3.0:1788830645.925368:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9e255d9b1800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788830645.955751:0:13067:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788830645.955764:0:13067:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:3.0:1788830645.955769:0:13067:0:(genops.c:885:class_export_put()) final put ffff9e255d9b3000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788830645.955774:0:13067:0:(genops.c:844:class_export_destroy()) destroying export ffff9e255d9b3000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1788830645.955783:0:13067:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:3.0:1788830645.955910:0:13067:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9e255d9b0000 00000020:01000000:3.0:1788830645.955929:0:13067:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:3.0:1788830645.955932:0:13067:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788830645.955945:0:13067:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788830645.955950:0:13067:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff9e25448319b8) has no exports 00000100:00100000:3.0:1788830645.956034:0:5834:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9e25472eb200:5834] 2 exiting: rc = 0 00000100:00100000:2.0:1788830645.958025:0:8202:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9e2565fc3a00:8202] 3 exiting: rc = 0 00000100:00100000:0.0:1788830645.959482:0:5832:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9e2553aa9200:5832] 0 exiting: rc = 1 00000100:00100000:0.0:1788830645.959573:0:5833:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9e25472ea600:5833] 1 exiting: rc = 0 00000100:00100000:3.0:1788830645.960000:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830645.960008:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830645.960014:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830645.960019:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830645.960023:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830645.960029:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830645.960034:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830645.960039:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830645.960044:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830645.960049:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830645.960054:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830645.960067:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830645.960073:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830645.960078:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830645.960086:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830645.960092:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830645.960108:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830645.960114:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830645.960128:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830645.960133:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830645.960138:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830645.960144:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830645.960149:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830645.960154:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830645.960159:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830645.960164:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830645.960169:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830645.960175:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830645.960188:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830645.960195:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830645.960201:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830645.960206:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830645.960222:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830645.960228:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830645.960233:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830645.960238:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830645.960244:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830645.960259:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830645.960265:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830645.960270:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830645.960275:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830645.960280:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830645.960285:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830645.960291:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830645.960296:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830645.960301:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830645.960306:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830645.960312:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830645.960317:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830645.960322:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830645.960328:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830645.960333:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830645.960337:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830645.960342:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830645.960346:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830645.960351:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830645.960356:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830645.960360:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830645.960364:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830645.960370:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830645.960375:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830645.960382:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830645.960388:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830645.960395:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788830645.972615:0:5836:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9e25472ebe00:5836] 1 exiting: rc = 0 00000100:00100000:3.0:1788830645.972633:0:5835:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9e25472ebc00:5835] 0 exiting: rc = 1 00000100:00100000:0.0:1788830645.974073:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788830645.974084:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788830645.974090:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788830645.974097:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788830645.974102:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788830645.974109:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788830645.974114:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788830645.974120:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788830645.974125:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788830645.974132:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788830645.974138:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788830645.974143:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788830645.974151:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788830645.974156:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788830645.974160:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788830645.974177:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788830645.974182:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788830645.974187:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788830645.974194:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788830645.974199:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788830645.974204:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788830645.974208:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788830645.974213:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788830645.974217:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788830645.974222:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788830645.974227:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788830645.974232:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788830645.974237:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788830645.974243:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788830645.974257:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788830645.974262:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788830645.974267:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788830645.974272:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788830645.974276:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788830645.974282:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788830645.974286:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788830645.974291:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788830645.974296:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788830645.974302:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788830645.974307:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788830645.974311:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788830645.974316:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788830645.974320:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788830645.974324:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788830645.974329:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788830645.974334:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788830645.974338:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788830645.974343:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788830645.974348:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788830645.974353:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788830645.974365:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788830645.974370:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788830645.974375:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788830645.974380:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788830645.974384:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788830645.974390:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788830645.974395:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788830645.974399:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788830645.974404:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788830645.974409:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788830645.974413:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788830645.974418:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788830645.974422:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788830645.974427:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788830645.975075:0:5837:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9e2553aa9400:5837] 0 exiting: rc = 1 00000100:00100000:0.0:1788830645.976923:0:5838:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9e2553aa8200:5838] 1 exiting: rc = 0 00000100:00100000:3.0:1788830645.977985:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830645.977995:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830645.978019:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830645.978028:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830645.978033:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830645.978040:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830645.978047:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830645.978053:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830645.978059:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830645.978066:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830645.978072:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830645.978078:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830645.978085:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830645.978090:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830645.978097:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830645.978137:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830645.978145:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830645.978153:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830645.978159:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830645.978165:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830645.978171:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830645.978178:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830645.978184:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830645.978190:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830645.978196:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830645.978203:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830645.978210:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830645.978231:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830645.978239:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830645.978255:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830645.978262:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830645.978268:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830645.978274:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830645.978280:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830645.978286:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830645.978292:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830645.978298:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830645.978312:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830645.978318:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830645.978344:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830645.978353:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830645.978359:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830645.978366:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830645.978373:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830645.978379:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830645.978386:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830645.978393:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830645.978399:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830645.978405:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830645.978411:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830645.978417:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830645.978438:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830645.978445:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830645.978451:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830645.978457:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830645.978463:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830645.978469:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830645.978475:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830645.978480:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830645.978486:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830645.978492:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830645.978497:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830645.978503:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830645.978520:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830645.998473:0:5840:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9e2547232800:5840] 1 exiting: rc = 0 00000100:00100000:1.0:1788830645.999502:0:5839:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9e2563e37e00:5839] 0 exiting: rc = 1 00000100:00100000:3.0:1788830646.002753:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.002764:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.002769:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.002774:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.002780:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.002786:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.002790:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.002807:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.002812:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.002817:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.002822:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.002827:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.002833:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.002838:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.002843:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.002848:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.002853:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.002859:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.002863:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.002868:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.002873:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.002878:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.002882:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.002888:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.002892:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.002897:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.002902:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.002907:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.002912:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.002917:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.002922:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.002927:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.002931:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.002937:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.002942:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.002949:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.002953:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.002959:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.002964:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.002969:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.002974:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.002979:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.002992:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.002997:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.003001:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.003006:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.003010:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.003015:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.003019:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.003024:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.003029:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.003034:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.003039:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.003044:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.003049:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.003055:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.003060:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.003065:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.003070:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.003075:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.003080:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.003085:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.003090:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.003094:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.004077:0:5842:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9e2547233800:5842] 1 exiting: rc = 0 00000100:00100000:2.0:1788830646.012639:0:5841:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9e2563e37600:5841] 0 exiting: rc = 1 00000100:00100000:3.0:1788830646.036682:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.036692:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.036698:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.036703:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.036726:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.036736:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.036741:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.036746:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.036751:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.036756:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.036762:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.036766:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.036786:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.036791:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.036796:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.036801:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.036806:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.036811:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.036816:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.036821:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.036827:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.036832:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.036837:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.036842:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.036846:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.036852:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.036857:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.036862:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.036868:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.036872:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.036877:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.036882:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.036887:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.036891:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.036897:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.036904:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.040548:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.040568:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.040574:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.040580:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.040585:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.040590:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.040595:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.040600:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.040605:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.040610:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.040615:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.040632:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.040637:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.040642:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.040647:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.040652:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.040657:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.040663:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.040669:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.040674:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.040680:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.040686:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.040691:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.040695:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.040701:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.040705:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.040725:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.040730:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.042635:0:5843:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9e2547233000:5843] 0 exiting: rc = 1 00000100:00100000:0.0:1788830646.043962:0:5844:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9e2547233400:5844] 1 exiting: rc = 0 00000100:00100000:3.0:1788830646.044072:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.044081:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.044089:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.044111:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.044127:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.044135:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.044141:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.044148:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.044154:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.044161:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.044170:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.044176:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.044184:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.044190:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.044196:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.044203:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.044210:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.044228:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.044236:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.044255:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.044266:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.044274:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.044284:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.044289:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.044294:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.044299:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.044305:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.044311:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.044316:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.044320:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.044325:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.044330:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.044335:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.044341:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.044347:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.044352:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.044357:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.044362:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.044367:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.044372:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.044377:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.044387:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.044394:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.044469:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.044475:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.044480:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.044486:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.044491:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.044495:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.044501:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.044506:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.044512:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.044524:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.044529:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.044534:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.044539:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.044543:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.044548:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.044553:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.044558:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.044563:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.044567:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.044573:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830646.044584:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788830646.045697:0:5845:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9e25537f9400:5845] 0 exiting: rc = 1 00000100:00100000:0.0:1788830646.047256:0:5846:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9e25537f8200:5846] 1 exiting: rc = 0 00000100:00100000:3.0:1788830646.047926:0:5847:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9e2563e36000:5847] 2 exiting: rc = 0 00000100:00100000:0.0:1788830646.048012:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788830646.048021:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788830646.048026:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788830646.048032:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788830646.048039:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788830646.048062:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788830646.048071:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788830646.048076:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788830646.048083:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788830646.048091:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788830646.048097:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788830646.048103:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788830646.048113:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788830646.048120:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788830646.048125:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788830646.048145:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788830646.048150:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788830646.048155:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788830646.048161:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788830646.048166:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788830646.048173:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788830646.048180:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788830646.048186:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788830646.048190:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788830646.048195:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788830646.048201:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788830646.048207:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788830646.048213:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788830646.048218:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788830646.048238:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788830646.048258:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788830646.048265:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788830646.048272:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788830646.048279:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788830646.048286:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788830646.048294:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788830646.048302:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788830646.048314:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788830646.048393:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788830646.048399:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788830646.048405:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788830646.048410:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788830646.048416:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788830646.048421:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788830646.048427:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788830646.048433:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788830646.048439:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788830646.048452:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788830646.048458:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788830646.048470:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788830646.048482:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788830646.048489:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788830646.048494:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788830646.048511:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788830646.048516:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788830646.048521:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788830646.048527:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788830646.048533:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788830646.048539:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788830646.048544:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788830646.048551:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788830646.048557:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788830646.048563:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788830646.048579:0:13067:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1788830646.057083:0:13067:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788830646.057097:0:13067:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1788830646.057103:0:13067:0:(genops.c:885:class_export_put()) final put ffff9e2544821800/MDS_uuid 00000020:00000080:0.0:1788830646.057108:0:13067:0:(genops.c:844:class_export_destroy()) destroying export ffff9e2544821800/MDS_uuid for MDS 00000020:01000000:0.0:1788830646.057114:0:13067:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1788830646.057269:0:13067:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:0.0:1788830646.304268:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788830647.323906:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788830648.357397:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788830648.431017:0:13222:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:0.0:1788830648.449603:0:13222:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:0.0:1788830648.449653:0:13222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.121@tcp lock: ffff9e257d945a00/0x575506951eea0b12 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea0b19 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830648.449668:0:13222:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: ffff9e257d945a00/0x575506951eea0b12 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x575506951eea0b19 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830648.449675:0:13222:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: ffff9e257d945a00/0x575506951eea0b12 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x575506951eea0b19 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830648.449682:0:13222:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.121@tcp lock: ffff9e257d945a00/0x575506951eea0b12 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x575506951eea0b19 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830648.449748:0:13222:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788830648.449754:0:13222:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788830648.449776:0:13222:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788830648.449780:0:13222:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788830648.449786:0:13222:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788830648.449792:0:13222:0:(import.c:65:import_set_state_nolock()) ffff9e257fd60800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:0.0:1788830648.449798:0:13222:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788830648.449799:0:13222:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788830648.449803:0:13222:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788830648.450621:0:13222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.121@tcp lock: ffff9e2445b7ea00/0x575506951eea0b20 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea0b27 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830648.450634:0:13222:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: ffff9e2445b7ea00/0x575506951eea0b20 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x575506951eea0b27 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830648.450641:0:13222:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: ffff9e2445b7ea00/0x575506951eea0b20 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x575506951eea0b27 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830648.450648:0:13222:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.121@tcp lock: ffff9e2445b7ea00/0x575506951eea0b20 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x575506951eea0b27 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830648.450670:0:13222:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788830648.450676:0:13222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.121@tcp lock: ffff9e2540031200/0x575506951eea0d57 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea0d5e expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830648.450683:0:13222:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: ffff9e2540031200/0x575506951eea0d57 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x575506951eea0d5e expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830648.450701:0:13222:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: ffff9e2540031200/0x575506951eea0d57 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x575506951eea0d5e expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830648.450725:0:13222:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.121@tcp lock: ffff9e2540031200/0x575506951eea0d57 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x575506951eea0d5e expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830648.450733:0:13222:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 10000000:01000000:0.0:1788830648.450737:0:13222:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:0.0:1788830648.450753:0:13222:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:0.0:1788830648.450757:0:13222:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:0.0:1788830648.450761:0:13222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788830648.450766:0:13222:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788830648.450770:0:13222:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff9e254482cd28) has no exports 00000020:00080000:0.0:1788830648.450791:0:13222:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff9e254482cd28) has no exports 00000020:01000000:0.0:1788830648.452400:0:13222:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9e2445984ba0 - data ffff9e2546b8f360/ffff9e256575f400 00000020:01000000:0.0:1788830648.452554:0:13222:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9e2565cd8000 - data ffff9e2572770510/ffff9e2444a07000 00010000:00010000:1.0:1788830648.452916:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788830648.452925:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.121@tcp lock: ffff9e257d945a00/0x575506951eea0b12 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x575506951eea0b19 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830648.452936:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e257d945a00 already unused, calling callback (ffffffffc1aebc20) 10000000:00010000:1.0:1788830648.452940:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.121@tcp lock: ffff9e257d945a00/0x575506951eea0b12 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x575506951eea0b19 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830648.452949:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.121@tcp lock: ffff9e257d945a00/0x575506951eea0b12 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x575506951eea0b19 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788830648.452956:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.121@tcp lock: ffff9e257d945a00/0x575506951eea0b12 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x575506951eea0b19 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788830648.452962:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788830648.452965:0:5821:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788830648.452967:0:5821:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788830648.453005:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.121@tcp lock: ffff9e257d945a00/0x575506951eea0b12 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x575506951eea0b19 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830648.453024:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788830648.453051:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.121@tcp lock: ffff9e257d945a00/0x575506951eea0b12 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x575506951eea0b19 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830648.453058:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.121@tcp lock: ffff9e257d945a00/0x575506951eea0b12 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x575506951eea0b19 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830648.453069:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788830648.453072:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.121@tcp lock: ffff9e2445b7ea00/0x575506951eea0b20 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x575506951eea0b27 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830648.453077:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2445b7ea00 already unused, calling callback (ffffffffc1aebc20) 10000000:00010000:1.0:1788830648.453080:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.121@tcp lock: ffff9e2445b7ea00/0x575506951eea0b20 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x575506951eea0b27 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830648.453087:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.121@tcp lock: ffff9e2445b7ea00/0x575506951eea0b20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x575506951eea0b27 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788830648.453093:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.121@tcp lock: ffff9e2445b7ea00/0x575506951eea0b20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x575506951eea0b27 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788830648.453098:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788830648.453101:0:5821:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:1.0:1788830648.453103:0:5821:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:1.0:1788830648.453116:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.121@tcp lock: ffff9e2445b7ea00/0x575506951eea0b20 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x575506951eea0b27 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830648.453123:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788830648.453138:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.121@tcp lock: ffff9e2445b7ea00/0x575506951eea0b20 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x575506951eea0b27 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830648.453155:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.121@tcp lock: ffff9e2445b7ea00/0x575506951eea0b20 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x575506951eea0b27 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830648.453164:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788830648.453167:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.121@tcp lock: ffff9e2540031200/0x575506951eea0d57 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x575506951eea0d5e expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830648.453173:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2540031200 already unused, calling callback (ffffffffc1aebc20) 10000000:00010000:1.0:1788830648.453176:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.121@tcp lock: ffff9e2540031200/0x575506951eea0d57 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x575506951eea0d5e expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830648.453182:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.121@tcp lock: ffff9e2540031200/0x575506951eea0d57 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x575506951eea0d5e expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788830648.453189:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.121@tcp lock: ffff9e2540031200/0x575506951eea0d57 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x575506951eea0d5e expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788830648.453194:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788830648.453196:0:5821:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1788830648.453199:0:5821:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1788830648.453244:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.121@tcp lock: ffff9e2540031200/0x575506951eea0d57 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x575506951eea0d5e expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830648.453251:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788830648.453257:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.121@tcp lock: ffff9e2540031200/0x575506951eea0d57 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x575506951eea0d5e expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830648.453263:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.121@tcp lock: ffff9e2540031200/0x575506951eea0d57 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x575506951eea0d5e expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830648.453284:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788830648.453286:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788830648.453288:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788830648.453297:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788830648.453316:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25747c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1745cc3d-3952-4cd4-9020-9b8acb483105:3307:1875724595185920:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788830648.453385:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830648.453441:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25747c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1745cc3d-3952-4cd4-9020-9b8acb483105:3309:1875724595186048:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788830648.453464:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830648.453479:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788830648.453484:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25747c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1745cc3d-3952-4cd4-9020-9b8acb483105:3309:1875724595186176:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788830648.453504:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788830648.453598:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788830648.453616:0:11161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595185920 00000100:00100000:3.0:1788830648.453623:0:11161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595185920 00000100:00100000:3.0:1788830648.453664:0:11161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595186048 00000100:00100000:3.0:1788830648.453667:0:11161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595186048 00000100:00100000:3.0:1788830648.453674:0:11161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595186176 00000100:00100000:3.0:1788830648.453676:0:11161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595186176 00000100:00100000:3.0:1788830648.453687:0:11161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788830648.453695:0:11161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e255da6b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3307:x1875724595185920:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1788830648.453702:0:11161:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788830648 with bad export cookie 6292943291858683899 00000100:00100000:1.0:1788830648.458302:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788830648.458317:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25747c0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3309:x1875724595186048:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1788830648.458326:0:5818:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788830648 with bad export cookie 6292943291858683899 00000100:00100000:1.0:1788830648.458432:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25747c0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3309:x1875724595186048:12345-0@lo:103:ldlm_bl.0 Request processed in 116us (4967us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788830648.458439:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788830648.458464:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788830648.458468:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25747c1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3309:x1875724595186176:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1788830648.458472:0:5818:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788830648 with bad export cookie 6292943291858683899 00000100:00100000:1.0:1788830648.458498:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25747c1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3309:x1875724595186176:12345-0@lo:103:ldlm_bl.0 Request processed in 28us (4994us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788830648.458504:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:1.0:1788830648.458546:0:3309:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.201.121@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788830648.458553:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9e2545175800 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1788830648.458573:0:3309:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.201.121@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00100000:3.0:1788830648.461343:0:11161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e255da6b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3307:x1875724595185920:12345-0@lo:103:ldlm_bl.0 Request processed in 7642us (7953us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788830648.461356:0:11161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:2.0:1788830648.461859:0:3307:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.201.121@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788830648.488615:0:3309:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.201.121@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1788830648.488621:0:3309:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1788830648.488633:0:3309:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e25747c1500 x1875724595185920/t0(0) o103->MGC192.168.201.121@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788830664 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788830648.488648:0:3309:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e25747c2d80 x1875724595186048/t0(0) o103->MGC192.168.201.121@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788830664 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788830648.488656:0:3309:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e25747c3800 x1875724595186176/t0(0) o103->MGC192.168.201.121@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788830664 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788830648.488957:0:3307:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9e2545175800 already not connected (conn 1, was 1): DISCONN 10000000:01000000:1.0:1788830648.489081:0:3309:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1788830648.489085:0:3309:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1788830648.489086:0:3309:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1788830648.489090:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9e2545175800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788830648.489095:0:3309:0:(import.c:510:import_select_connection()) MGC192.168.201.121@tcp: connect to NID 0@lo last attempt 185 00000100:00080000:1.0:1788830648.489103:0:3309:0:(import.c:624:import_select_connection()) MGC192.168.201.121@tcp: import ffff9e2545175800 using connection 192.168.201.121@tcp/0@lo 00000100:00100000:3.0:1788830648.490899:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25747c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1745cc3d-3952-4cd4-9020-9b8acb483105:3307:1875724595185920:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788830648.497282:0:3309:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e2545cbea00 x1875724595186304/t0(0) o250->MGC192.168.201.121@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788830648.497354:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2545cbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1745cc3d-3952-4cd4-9020-9b8acb483105:3306:1875724595186304:0@lo:250:ptlrpcd_00_02.0 00000400:00000100:1.0:1788830648.497409:0:3306:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875724595186304 offset 0 length 520: 4 00000100:00100000:3.0:1788830648.497478:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25747c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1745cc3d-3952-4cd4-9020-9b8acb483105:3309:1875724595186048:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788830648.497516:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25747c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1745cc3d-3952-4cd4-9020-9b8acb483105:3309:1875724595186176:0@lo:103:ldlm_bl.0 00100000:10000000:3.0:1788830648.524282:0:13222:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1788830648.557563:0:13222:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x575506951eea0960 00000020:00000080:2.0:1788830648.557575:0:13222:0:(genops.c:885:class_export_put()) final put ffff9e2444ada800/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1788830648.557595:0:13222:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e2565dcd800 from lustre-OST0000, refs=2 00000020:01000004:2.0:1788830648.557598:0:13222:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e2565dcd800 2 00000020:01000004:2.0:1788830648.557601:0:13222:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9e2565dcd800 from lustre-OST0000 00000020:00000080:2.0:1788830648.557642:0:13222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788830648.557653:0:13222:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1788830648.557657:0:13222:0:(genops.c:885:class_export_put()) final put ffff9e2444ada000/lustre-OST0000_UUID 00000020:00000080:2.0:1788830648.557660:0:13222:0:(genops.c:844:class_export_destroy()) destroying export ffff9e2444ada000/lustre-OST0000_UUID for lustre-OST0000 00000020:00000080:1.0:1788830648.557729:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e2444ada800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:2.0:1788830648.557972:0:13222:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:3.0:1788830648.558151:0:13222:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:3.0:1788830648.558157:0:13222:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1788830648.558161:0:13222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788830648.558167:0:13222:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788830648.558174:0:13222:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9e2444adb000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788830648.558181:0:13222:0:(genops.c:1553:class_disconnect_exports()) OBD device 13 (ffff9e2544830000) has exports, disconnecting them 00000020:00080000:3.0:1788830648.558186:0:13222:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9e2444adb000), last request at 1788830447 00000020:00000080:3.0:1788830648.558191:0:13222:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x575506951eea0998 00000020:00080000:3.0:1788830648.558223:0:13222:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e2444adb000): rc 0 00000020:00000080:3.0:1788830648.558228:0:13222:0:(genops.c:885:class_export_put()) final put ffff9e2444adb000/lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1788830648.558255:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e2444adb000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1788830648.560837:0:13222:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1788830648.560848:0:13222:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788830648.560852:0:13222:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788830648.560860:0:13222:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788830648.560924:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e257fd60800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1788830648.561101:0:13222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788830648.561110:0:13222:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:2.0:1788830648.561116:0:13222:0:(genops.c:885:class_export_put()) final put ffff9e2544f0d800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:2.0:1788830648.561120:0:13222:0:(genops.c:844:class_export_destroy()) destroying export ffff9e2544f0d800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:2.0:1788830648.561126:0:13222:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:2.0:1788830648.561214:0:13222:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e2565dcd800 1 00000020:00000080:2.0:1788830648.561221:0:13222:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x575506951eea08db 00000020:00000080:2.0:1788830648.561227:0:13222:0:(genops.c:885:class_export_put()) final put ffff9e2544f08800/lustre-OST0000-osd_UUID 00000020:01000000:2.0:1788830648.561240:0:13222:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:2.0:1788830648.561245:0:13222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788830648.561250:0:13222:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788830648.561254:0:13222:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff9e25474f3370) has no exports 00000020:00000080:1.0:1788830648.561307:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e2544f08800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1788830648.592865:0:13222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788830648.592882:0:13222:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:2.0:1788830648.592888:0:13222:0:(genops.c:885:class_export_put()) final put ffff9e2565dce800/lustre-OST0000-osd_UUID 00000020:00000080:2.0:1788830648.592893:0:13222:0:(genops.c:844:class_export_destroy()) destroying export ffff9e2565dce800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:2.0:1788830648.592901:0:13222:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:2.0:1788830648.593066:0:13222:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9e2565dc9800 00000020:02000400:2.0:1788830648.593118:0:13222:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00000100:00080000:3.0:1788830649.052868:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1745cc3d-3952-4cd4-9020-9b8acb483105->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788830649.052877:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 1745cc3d-3952-4cd4-9020-9b8acb483105->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788830649.052881:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788830649.052885:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788830649.052889:0:36:0:(import.c:65:import_set_state_nolock()) ffff9e2445b74000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788830649.052897:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 397 00000100:00080000:3.0:1788830649.052903:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788830649.052909:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9e2445b74000 using connection 192.168.201.121@tcp/0@lo 00000100:00100000:3.0:1788830649.052946:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e2545cbd500 x1875724595186432/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788830649.053006:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2545cbd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3306:1875724595186432:0@lo:38:kworker.0 00000400:00000100:0.0:1788830649.053055:0:3306:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875724595186432 offset 0 length 520: 4 00010000:00010000:2.0:1788830649.375859:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788830650.396138:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788830650.818864:0:13372:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:0.0:1788830650.826414:0:13372:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:0.0:1788830650.826491:0:13372:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.121@tcp lock: ffff9e25820ffc00/0x575506951eea0af6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea0afd expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830650.826507:0:13372:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: ffff9e25820ffc00/0x575506951eea0af6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x575506951eea0afd expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830650.826516:0:13372:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: ffff9e25820ffc00/0x575506951eea0af6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x575506951eea0afd expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830650.826533:0:13372:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.121@tcp lock: ffff9e25820ffc00/0x575506951eea0af6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x575506951eea0afd expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830650.826655:0:13372:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788830650.826662:0:13372:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788830650.826686:0:13372:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788830650.826698:0:13372:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e2545cbd500 x1875724595186432/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788830664 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788830650.826731:0:13372:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788830650.826738:0:13372:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788830650.826794:0:3306:0:(import.c:65:import_set_state_nolock()) ffff9e2445b74000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788830650.826800:0:3306:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-5) 00000100:00100000:3.0:1788830650.826804:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2545cbd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3306:1875724595186432:0@lo:38:kworker.0 00000100:00080000:0.0:1788830650.826816:0:13372:0:(import.c:65:import_set_state_nolock()) ffff9e2445b74000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:0.0:1788830650.826820:0:13372:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788830650.826822:0:13372:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788830650.826825:0:13372:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788830650.827823:0:13372:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.121@tcp lock: ffff9e2445b7e000/0x575506951eea0b04 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea0b0b expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830650.827837:0:13372:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: ffff9e2445b7e000/0x575506951eea0b04 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x575506951eea0b0b expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830650.827845:0:13372:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: ffff9e2445b7e000/0x575506951eea0b04 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x575506951eea0b0b expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830650.827850:0:13372:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.121@tcp lock: ffff9e2445b7e000/0x575506951eea0b04 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x575506951eea0b0b expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830650.828066:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788830650.828074:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.121@tcp lock: ffff9e25820ffc00/0x575506951eea0af6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x575506951eea0afd expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830650.828081:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e25820ffc00 already unused, calling callback (ffffffffc1aebc20) 10000000:00010000:1.0:1788830650.828085:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.121@tcp lock: ffff9e25820ffc00/0x575506951eea0af6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x575506951eea0afd expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830650.828101:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.121@tcp lock: ffff9e25820ffc00/0x575506951eea0af6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x575506951eea0afd expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788830650.828108:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.121@tcp lock: ffff9e25820ffc00/0x575506951eea0af6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x575506951eea0afd expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788830650.828113:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788830650.828116:0:5821:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788830650.828118:0:5821:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788830650.828131:0:5821:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9e2545175800 00010000:00010000:1.0:1788830650.828135:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.121@tcp lock: ffff9e25820ffc00/0x575506951eea0af6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x575506951eea0afd expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830650.828140:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.121@tcp lock: ffff9e25820ffc00/0x575506951eea0af6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x575506951eea0afd expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830650.828151:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788830650.828153:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.121@tcp lock: ffff9e2445b7e000/0x575506951eea0b04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x575506951eea0b0b expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830650.828158:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2445b7e000 already unused, calling callback (ffffffffc1aebc20) 10000000:00010000:1.0:1788830650.828160:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.121@tcp lock: ffff9e2445b7e000/0x575506951eea0b04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x575506951eea0b0b expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830650.828177:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.121@tcp lock: ffff9e2445b7e000/0x575506951eea0b04 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x575506951eea0b0b expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788830650.828182:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.121@tcp lock: ffff9e2445b7e000/0x575506951eea0b04 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x575506951eea0b0b expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788830650.828196:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788830650.828198:0:5821:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:1.0:1788830650.828202:0:5821:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9e2545175800 00010000:00010000:1.0:1788830650.828205:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.121@tcp lock: ffff9e2445b7e000/0x575506951eea0b04 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x575506951eea0b0b expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830650.828211:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788830650.828213:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788830650.828215:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788830650.828272:0:13372:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788830650.828277:0:13372:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.121@tcp lock: ffff9e2445b7e000/0x575506951eea0b04 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x575506951eea0b0b expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830650.828291:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788830650.828295:0:13372:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.121@tcp lock: ffff9e2445b7fa00/0x575506951eea0d42 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea0d49 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830650.828303:0:13372:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: ffff9e2445b7fa00/0x575506951eea0d42 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x575506951eea0d49 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830650.828309:0:13372:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: ffff9e2445b7fa00/0x575506951eea0d42 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x575506951eea0d49 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830650.828314:0:13372:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.121@tcp lock: ffff9e2445b7fa00/0x575506951eea0d42 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x575506951eea0d49 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830650.828358:0:13372:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788830650.828362:0:13372:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:0.0:1788830650.828366:0:13372:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:0.0:1788830650.828383:0:13372:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:0.0:1788830650.828387:0:13372:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:0.0:1788830650.828393:0:13372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788830650.828397:0:13372:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788830650.828402:0:13372:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff9e25474f4d28) has no exports 00000020:00080000:0.0:1788830650.828423:0:13372:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff9e25474f4d28) has no exports 00000020:01000000:0.0:1788830650.830060:0:13372:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9e2445984f00 - data ffff9e2546a0ad80/ffff9e2445a49000 00000020:01000000:0.0:1788830650.830222:0:13372:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9e257eea8c60 - data ffff9e2546b8eca8/ffff9e2444a4a000 00010000:00010000:1.0:1788830650.831238:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788830650.831249:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.121@tcp lock: ffff9e2445b7fa00/0x575506951eea0d42 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x575506951eea0d49 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830650.831261:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2445b7fa00 already unused, calling callback (ffffffffc1aebc20) 10000000:00010000:1.0:1788830650.831266:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.121@tcp lock: ffff9e2445b7fa00/0x575506951eea0d42 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x575506951eea0d49 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830650.831276:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.121@tcp lock: ffff9e2445b7fa00/0x575506951eea0d42 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x575506951eea0d49 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788830650.831284:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.121@tcp lock: ffff9e2445b7fa00/0x575506951eea0d42 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x575506951eea0d49 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788830650.831290:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788830650.831292:0:5821:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1788830650.831295:0:5821:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1788830650.831309:0:5821:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9e2545175800 00010000:00010000:1.0:1788830650.831314:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.121@tcp lock: ffff9e2445b7fa00/0x575506951eea0d42 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x575506951eea0d49 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830650.831335:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.121@tcp lock: ffff9e2445b7fa00/0x575506951eea0d42 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x575506951eea0d49 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830650.831361:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788830650.831363:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788830650.831365:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:0.0:1788830650.844620:0:13372:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1788830650.855506:0:13372:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x575506951eea09fa 00000020:00000080:2.0:1788830650.855516:0:13372:0:(genops.c:885:class_export_put()) final put ffff9e256563f800/lustre-OST0001-osd_UUID 00000020:01000004:2.0:1788830650.855546:0:13372:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e2444ab0800 from lustre-OST0001, refs=2 00000020:01000004:2.0:1788830650.855550:0:13372:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e2444ab0800 2 00000020:01000004:2.0:1788830650.855553:0:13372:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9e2444ab0800 from lustre-OST0001 00000020:00000080:2.0:1788830650.855578:0:13372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788830650.855589:0:13372:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:2.0:1788830650.855592:0:13372:0:(genops.c:885:class_export_put()) final put ffff9e2565638000/lustre-OST0001_UUID 00000020:00000080:2.0:1788830650.855595:0:13372:0:(genops.c:844:class_export_destroy()) destroying export ffff9e2565638000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:2.0:1788830650.855601:0:13372:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:2.0:1788830650.855779:0:13372:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 1745cc3d-3952-4cd4-9020-9b8acb483105->MGS 00010000:00010000:2.0:1788830650.855795:0:13372:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.121@tcp lock: ffff9e2540030400/0x575506951eea0928 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x575506951eea092f expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788830650.855808:0:13372:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.121@tcp lock: ffff9e2540030400/0x575506951eea0928 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x575506951eea092f expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788830650.855815:0:13372:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:2.0:1788830650.855818:0:13372:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:2.0:1788830650.855821:0:13372:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:2.0:1788830650.855834:0:13372:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9e2545175800 00010000:00010000:2.0:1788830650.855838:0:13372:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.121@tcp lock: ffff9e2540030400/0x575506951eea0928 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x575506951eea092f expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830650.855853:0:13372:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.121@tcp lock: ffff9e2565728400/0x575506951eea0b4a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x575506951eea0b51 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788830650.855860:0:13372:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.121@tcp lock: ffff9e2565728400/0x575506951eea0b4a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x575506951eea0b51 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788830650.855866:0:13372:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788830650.855868:0:13372:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:2.0:1788830650.855870:0:13372:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:2.0:1788830650.855878:0:13372:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9e2545175800 00010000:00010000:2.0:1788830650.855885:0:13372:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.121@tcp lock: ffff9e2565728400/0x575506951eea0b4a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x575506951eea0b51 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788830650.855900:0:13372:0:(import.c:65:import_set_state_nolock()) ffff9e2545175800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:2.0:1788830650.855904:0:13372:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1788830650.855906:0:13372:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1788830650.855907:0:13372:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1788830650.855911:0:13372:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1788830650.855921:0:13372:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e2545cbea00 x1875724595186304/t0(0) o250->MGC192.168.201.121@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788830658 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1788830650.855941:0:13372:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1788830650.855943:0:13372:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 10s for inflight to error out 00000020:00000080:0.0:1788830650.856024:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e256563f800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00100000:3.0:1788830650.856425:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2545cbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1745cc3d-3952-4cd4-9020-9b8acb483105:3306:1875724595186304:0@lo:250:ptlrpcd_00_02.0 10000000:01000000:2.0:1788830650.856529:0:13372:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1788830650.856537:0:13372:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x575506951eea07ed 00000020:00000080:2.0:1788830650.856543:0:13372:0:(genops.c:885:class_export_put()) final put ffff9e2544823800/1745cc3d-3952-4cd4-9020-9b8acb483105 00000020:01000000:2.0:1788830650.856557:0:13372:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.201.121@tcp (flags='') 00000020:00000080:2.0:1788830650.856562:0:13372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788830650.856567:0:13372:0:(obd_config.c:956:class_cleanup()) MGC192.168.201.121@tcp: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788830650.856570:0:13372:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff9e254482b370) has no exports 00000020:00000080:0.0:1788830650.856609:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e2544823800/1745cc3d-3952-4cd4-9020-9b8acb483105 for MGC192.168.201.121@tcp 10000000:01000000:0.0:1788830650.856793:0:5829:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:2.0:1788830650.856868:0:13372:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.201.121@tcp: client import never connected 00000100:00080000:2.0:1788830650.856871:0:13372:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:2.0:1788830650.856874:0:13372:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1788830650.856876:0:13372:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:2.0:1788830650.856878:0:13372:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1788830650.856914:0:13372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788830650.856920:0:13372:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.201.121@tcp (uuid 1745cc3d-3952-4cd4-9020-9b8acb483105) 00000020:01000000:2.0:1788830650.856926:0:13372:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1788830650.856929:0:13372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788830650.856932:0:13372:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788830650.856937:0:13372:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9e2445b71800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788830650.856942:0:13372:0:(genops.c:1553:class_disconnect_exports()) OBD device 16 (ffff9e256601cd28) has exports, disconnecting them 00000020:00080000:2.0:1788830650.856947:0:13372:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9e2445b71800), last request at 1788830464 00000020:00000080:2.0:1788830650.856957:0:13372:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x575506951eea0a24 00000020:00080000:2.0:1788830650.856967:0:13372:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e2445b71800): rc 0 00000020:00000080:2.0:1788830650.856971:0:13372:0:(genops.c:885:class_export_put()) final put ffff9e2445b71800/lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1788830650.857678:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e2545175800 for MGC192.168.201.121@tcp 00000020:00000080:0.0:1788830650.857692:0:36:0:(genops.c:885:class_export_put()) final put ffff9e2545171800/1745cc3d-3952-4cd4-9020-9b8acb483105 00000020:00000080:0.0:1788830650.857694:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e2545171800/1745cc3d-3952-4cd4-9020-9b8acb483105 for MGC192.168.201.121@tcp 00000020:01000000:0.0:1788830650.857700:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.201.121@tcp (1745cc3d-3952-4cd4-9020-9b8acb483105) 00000020:00000080:0.0:1788830650.857939:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e2445b71800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:3.0:1788830650.858797:0:13372:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:3.0:1788830650.858803:0:13372:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788830650.858807:0:13372:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788830650.858813:0:13372:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788830650.858875:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00000020:00000080:0.0:1788830650.859025:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e2445b74000 for lustre-MDT0000-lwp-OST0001 00010000:00010000:2.0:1788830650.870812:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00000100:00100000:0.0:1788830650.871067:0:5815:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9e25480c0e00:5815] 0 exiting: rc = 1 00000100:00100000:2.0:1788830650.871204:0:5816:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9e25480c0a00:5816] 1 exiting: rc = 0 00000100:00100000:2.0:1788830650.874853:0:8504:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_002: service thread [ffff9e257ff66400:8504] 2 exiting: rc = 0 00000100:00100000:3.0:1788830650.875001:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788830650.875462:0:5819:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9e2553724c00:5819] 2 exiting: rc = 0 00000100:00100000:3.0:1788830650.875560:0:11161:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9e256572a000:11161] 3 exiting: rc = 0 00000100:00100000:3.0:1788830650.875617:0:5817:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9e2553724200:5817] 0 exiting: rc = 1 00000100:00100000:0.0:1788830650.875801:0:5818:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9e2553725c00:5818] 1 exiting: rc = 0 00000100:00100000:3.0:1788830650.876004:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830650.876012:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830650.876019:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830650.876025:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830650.876031:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830650.876109:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830650.876117:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830650.876123:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830650.876128:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830650.876135:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830650.876142:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830650.876147:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830650.876153:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830650.876159:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830650.876174:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830650.876180:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830650.876187:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830650.876193:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830650.876199:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830650.876205:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830650.876212:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830650.876217:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830650.876233:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830650.876239:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830650.876243:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830650.876249:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830650.876254:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830650.876259:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830650.876264:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830650.876269:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830650.876274:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830650.876279:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830650.876284:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830650.876289:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830650.876294:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830650.876298:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830650.876303:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830650.876308:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830650.876312:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830650.876317:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830650.876323:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830650.876328:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830650.876334:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830650.876339:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830650.876344:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830650.876350:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830650.876355:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830650.876360:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830650.876365:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830650.876370:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830650.876375:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830650.876380:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830650.876385:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830650.876391:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830650.876396:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830650.876401:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830650.876407:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830650.876419:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830650.876424:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830650.876429:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830650.876434:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830650.876439:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830650.876445:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830650.876450:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1788830650.877519:0:13372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788830650.877529:0:13372:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:3.0:1788830650.877536:0:13372:0:(genops.c:885:class_export_put()) final put ffff9e257fc98800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:3.0:1788830650.877540:0:13372:0:(genops.c:844:class_export_destroy()) destroying export ffff9e257fc98800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:3.0:1788830650.877546:0:13372:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:3.0:1788830650.877588:0:13372:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e2444ab0800 1 00000020:00000080:3.0:1788830650.877595:0:13372:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x575506951eea09c9 00000020:00000080:3.0:1788830650.877602:0:13372:0:(genops.c:885:class_export_put()) final put ffff9e257f0df800/lustre-OST0001-osd_UUID 00000020:01000000:3.0:1788830650.877645:0:13372:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:3.0:1788830650.877650:0:13372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788830650.877655:0:13372:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788830650.877659:0:13372:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff9e25474f0000) has no exports 00000020:00000080:0.0:1788830650.888939:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e257f0df800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1788830650.896652:0:13372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788830650.896675:0:13372:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:1.0:1788830650.896682:0:13372:0:(genops.c:885:class_export_put()) final put ffff9e2444ab5000/lustre-OST0001-osd_UUID 00000020:00000080:1.0:1788830650.896687:0:13372:0:(genops.c:844:class_export_destroy()) destroying export ffff9e2444ab5000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:1.0:1788830650.896695:0:13372:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:1.0:1788830650.896909:0:13372:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9e2444ab2800 00000020:01000000:1.0:1788830650.896930:0:13372:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:1.0:1788830650.896934:0:13372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788830650.896938:0:13372:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788830650.896942:0:13372:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff9e2566018000) has no exports 00000020:00000080:1.0:1788830650.896963:0:13372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788830650.896970:0:13372:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:1.0:1788830650.896973:0:13372:0:(genops.c:885:class_export_put()) final put ffff9e2544f09000/OSS_uuid 00000020:00000080:1.0:1788830650.896975:0:13372:0:(genops.c:844:class_export_destroy()) destroying export ffff9e2544f09000/OSS_uuid for OSS 00000020:01000000:1.0:1788830650.896978:0:13372:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:1.0:1788830650.897002:0:5828:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:3.0:1788830650.899672:0:6680:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff9e257f0ca200:6680] 2 exiting: rc = 0 00000100:00100000:2.0:1788830650.900383:0:6679:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff9e254724a800:6679] 1 exiting: rc = 0 00000100:00100000:2.0:1788830650.900442:0:6677:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff9e254724ae00:6677] 0 exiting: rc = 1 00000100:00100000:0.0:1788830650.900926:0:12010:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff9e257ff66600:12010] 3 exiting: rc = 0 00000100:00100000:1.0:1788830650.901123:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.901132:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.901144:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.901152:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.901157:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.901171:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.901176:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.901181:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.901187:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.901203:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.901208:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.901213:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.901218:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.901223:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.901228:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.901233:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.901237:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.901242:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.901248:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.901253:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.901258:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.901263:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.901269:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.901274:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.901279:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.901284:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.901289:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.901293:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.901298:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.901304:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.901311:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.901316:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.901321:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.901326:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.901331:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.901337:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.901342:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.901347:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.901353:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.901359:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.901365:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.901370:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.901375:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.901381:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.901393:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.901398:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.901403:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.901408:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.901413:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.901418:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.901423:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.901427:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.901432:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.901437:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.901443:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.901448:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.901453:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.901458:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.901462:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.901467:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.901471:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.901476:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.901485:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.901491:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788830650.902561:0:6681:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9e254724ba00:6681] 0 exiting: rc = 1 00000100:00100000:3.0:1788830650.902649:0:6682:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9e254724a400:6682] 1 exiting: rc = 0 00000100:00100000:1.0:1788830650.902898:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.902906:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.902911:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.902916:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.902922:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.902927:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.902932:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.902937:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.902942:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.902947:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.902952:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.902956:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.902961:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.902966:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.902971:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.902985:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.902990:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.902995:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.903001:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.903006:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.903010:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.903015:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.903019:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.903023:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.903029:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.903033:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.903108:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.903115:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.903120:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.903126:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.903132:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.903137:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.903142:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.903147:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.903153:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.903160:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.903175:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.903181:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.903186:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.903191:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.903197:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.903203:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.903209:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.903214:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.903219:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.903224:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.903229:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.903235:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.903240:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.903245:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.903260:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.903265:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.903270:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.903276:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.903281:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.903287:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.903293:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.903299:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.903305:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.903310:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.903315:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.903321:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.903327:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.903333:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788830650.904183:0:6683:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9e257ede9400:6683] 0 exiting: rc = 1 00000100:00100000:2.0:1788830650.904363:0:6685:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9e257edca600:6685] 2 exiting: rc = 0 00000100:00100000:3.0:1788830650.904654:0:6684:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9e257ede8200:6684] 1 exiting: rc = 0 00000100:00100000:1.0:1788830650.904817:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.904824:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.904829:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.904834:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.904840:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.904854:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.904862:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.904868:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.904874:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.904880:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.904886:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.904892:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.904898:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.904904:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.904910:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.904915:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.904921:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.904926:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.904932:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.904937:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.904942:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.904959:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.904965:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.904971:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.904977:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.904983:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.904988:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.904993:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.904999:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.905004:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.905025:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.905032:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.905099:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.905105:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.905111:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.905116:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.905121:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.905127:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.905134:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.905139:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.905145:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.905151:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.905156:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.905170:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.905177:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.905183:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.905187:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.905193:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.905198:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.905203:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.905208:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.905213:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.905218:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.905224:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.905244:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.905258:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.905271:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.905277:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.905283:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.905289:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.905295:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.905300:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.905305:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.905311:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788830650.916188:0:6686:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9e257ede9600:6686] 0 exiting: rc = 1 00000100:00100000:3.0:1788830650.916295:0:6687:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9e257edcb800:6687] 1 exiting: rc = 0 00000100:00100000:1.0:1788830650.916411:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.916420:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.916425:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.916430:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.916435:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.916440:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.916445:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.916451:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.916456:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.916462:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.916466:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.916471:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.916477:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.916482:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.916487:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.916493:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.916498:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.916503:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.916508:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.916513:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.916518:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.916523:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.916528:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.916534:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.916539:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.916545:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.916550:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.916569:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.916574:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.916580:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.916584:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.916589:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.916594:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.916599:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.916603:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.916608:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.916613:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.916618:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.916624:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.916628:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.916633:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.916638:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.916643:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.916648:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.916652:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.916660:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.916666:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.916673:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.916680:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.916971:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.916979:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.916985:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.916990:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.916995:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.917001:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.917007:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.917012:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.917018:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.917023:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.917029:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.917035:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.917131:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.917145:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788830650.917150:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788830650.918478:0:6688:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9e257edc0a00:6688] 0 exiting: rc = 1 00000100:00100000:1.0:1788830650.918580:0:6689:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9e257edca400:6689] 1 exiting: rc = 0 00000100:00100000:3.0:1788830650.918671:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830650.918679:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830650.918685:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830650.918690:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830650.918831:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830650.918839:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830650.918845:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830650.918852:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830650.918858:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830650.918872:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830650.918878:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830650.918884:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830650.918891:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830650.918897:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830650.918903:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830650.918910:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830650.918929:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830650.918936:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830650.918941:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830650.918947:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830650.918954:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830650.918959:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830650.918964:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830650.918970:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830650.918976:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830650.918982:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830650.918987:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830650.918993:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830650.919013:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830650.919021:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830650.919026:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830650.919033:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830650.919110:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830650.919117:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830650.919123:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830650.919130:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830650.919135:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830650.919141:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830650.919147:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830650.919154:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830650.919186:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830650.919195:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830650.919201:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830650.919207:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830650.919220:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830650.919226:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830650.919232:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830650.919237:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830650.919243:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830650.919248:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830650.919254:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830650.919260:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830650.919280:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830650.919287:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830650.919293:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830650.919299:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830650.919307:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830650.919312:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830650.919318:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830650.919325:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830650.919331:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830650.919344:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830650.919352:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788830650.919358:0:13372:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:2.0:1788830650.928057:0:13372:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:0.0:1788830665.365876:0:13985:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg121-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1788830672.505218:0:14445:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788830672.505226:0:14445:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:0.0:1788830672.505364:0:14445:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9e25460f8000 00000020:01000004:0.0:1788830672.505385:0:14445:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:0.0:1788830672.505395:0:14445:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1788830672.505413:0:14445:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9e25448319b8) 00000020:00000080:0.0:1788830672.505430:0:14445:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788830672.545946:0:14445:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1788830672.557550:0:14445:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:2.0:1788830672.560594:0:14445:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 459: rc = 0 00100000:10000000:2.0:1788830672.560691:0:14445:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 459: rc = 0 00100000:10000000:2.0:1788830672.560788:0:14445:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 459: rc = 0 00100000:10000000:2.0:1788830672.560893:0:14445:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 459: rc = 0 00100000:10000000:2.0:1788830672.560994:0:14445:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 459: rc = 0 00100000:10000000:2.0:1788830672.561172:0:14445:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1788830672.561441:0:14445:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 459: rc = 0 00100000:10000000:2.0:1788830672.561691:0:14445:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 461: rc = 0 00100000:10000000:2.0:1788830672.565106:0:14445:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 267: rc = 0 00100000:10000000:2.0:1788830672.565191:0:14445:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 267: rc = 0 00100000:10000000:2.0:1788830672.568318:0:14445:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 273: rc = 0 00100000:10000000:2.0:1788830672.568688:0:14445:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 273: rc = 0 00100000:10000000:2.0:1788830672.568999:0:14445:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 273: rc = 0 00100000:10000000:2.0:1788830672.572038:0:14445:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 273: rc = 0 00100000:10000000:2.0:1788830672.574159:0:14445:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 273: rc = 0 00100000:10000000:2.0:1788830672.574421:0:14445:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 273: rc = 0 00100000:10000000:2.0:1788830672.575562:0:14445:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 273: rc = 0 00100000:10000000:2.0:1788830672.576017:0:14445:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 273: rc = 0 00100000:10000000:2.0:1788830672.576310:0:14445:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 273: rc = 0 00100000:10000000:2.0:1788830672.576625:0:14445:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 273: rc = 0 00100000:10000000:2.0:1788830672.577139:0:14445:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 273: rc = 0 00100000:10000000:2.0:1788830672.577451:0:14445:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 273: rc = 0 00100000:10000000:2.0:1788830672.578307:0:14445:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 654: rc = 0 00100000:10000000:2.0:1788830672.578644:0:14445:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 654: rc = 0 00100000:10000000:2.0:1788830672.579221:0:14445:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 654: rc = 0 00100000:10000000:2.0:1788830672.579590:0:14445:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 654: rc = 0 00100000:10000000:2.0:1788830672.580150:0:14445:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 654: rc = 0 00100000:10000000:2.0:1788830672.580457:0:14445:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 654: rc = 0 00100000:10000000:2.0:1788830672.581011:0:14445:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 654: rc = 0 00100000:10000000:2.0:1788830672.581330:0:14445:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 654: rc = 0 00100000:10000000:2.0:1788830672.581635:0:14445:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 654: rc = 0 00100000:10000000:2.0:1788830672.582293:0:14445:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 654: rc = 0 00100000:10000000:2.0:1788830672.582597:0:14445:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 654: rc = 0 00100000:10000000:2.0:1788830672.583194:0:14445:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 654: rc = 0 00100000:10000000:2.0:1788830672.583555:0:14445:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 654: rc = 0 00100000:10000000:2.0:1788830672.583982:0:14445:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 654: rc = 0 00100000:10000000:2.0:1788830672.584207:0:14445:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 654: rc = 0 00100000:10000000:2.0:1788830672.584607:0:14445:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 654: rc = 0 00100000:10000000:2.0:1788830672.585144:0:14445:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 654: rc = 0 00100000:10000000:2.0:1788830672.585546:0:14445:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 654: rc = 0 00100000:10000000:2.0:1788830672.586004:0:14445:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 654: rc = 0 00100000:10000000:2.0:1788830672.586354:0:14445:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 654: rc = 0 00100000:10000000:2.0:1788830672.586679:0:14445:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 654: rc = 0 00100000:10000000:2.0:1788830672.587318:0:14445:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 654: rc = 0 00100000:10000000:2.0:1788830672.587756:0:14445:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 654: rc = 0 00100000:10000000:2.0:1788830672.588007:0:14445:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 654: rc = 0 00100000:10000000:2.0:1788830672.588218:0:14445:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 654: rc = 0 00100000:10000000:2.0:1788830672.588905:0:14445:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 654: rc = 0 00100000:10000000:2.0:1788830672.589149:0:14445:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 654: rc = 0 00100000:10000000:2.0:1788830672.589977:0:14445:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 654: rc = 0 00100000:10000000:2.0:1788830672.590430:0:14445:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 654: rc = 0 00100000:10000000:2.0:1788830672.591416:0:14445:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 654: rc = 0 00100000:10000000:2.0:1788830672.591937:0:14445:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 654: rc = 0 00100000:10000000:2.0:1788830672.592418:0:14445:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 654: rc = 0 00100000:10000000:2.0:1788830672.593096:0:14445:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 770: rc = 0 00100000:10000000:0.0:1788830672.594359:0:14445:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:1.0:1788830672.598620:0:14445:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 268: rc = 0 00100000:10000000:1.0:1788830672.598946:0:14445:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:1.0:1788830672.599021:0:14445:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 268: rc = 0 00100000:10000000:1.0:1788830672.599214:0:14445:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:1.0:1788830672.599546:0:14445:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 268: rc = 0 00100000:10000000:1.0:1788830672.600038:0:14445:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:1.0:1788830672.600092:0:14445:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 643: rc = 0 00100000:10000000:1.0:1788830672.600660:0:14445:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:1.0:1788830672.601009:0:14445:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 643: rc = 0 00100000:10000000:1.0:1788830672.601198:0:14445:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:1.0:1788830672.601326:0:14445:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 643: rc = 0 00000020:00000080:1.0:1788830672.601653:0:14445:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1788830672.601661:0:14445:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788830672.601670:0:14445:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x575506951eea1ae0 00000020:01000004:1.0:1788830672.601677:0:14445:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:1.0:1788830672.601682:0:14445:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1788830672.601686:0:14445:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9e25460f8000 from MGS 00000020:01000004:1.0:1788830672.601689:0:14445:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1788830672.601698:0:14445:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9e25474f0000) 00000020:00000080:1.0:1788830672.601705:0:14445:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1788830672.601994:0:14445:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e25460f8000 from MGS, refs=2 00080000:01000000:1.0:1788830672.601999:0:14445:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788830672.602004:0:14445:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x575506951eea1aee 00000100:00100000:1.0:1788830672.602093:0:14445:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1788830672.602332:0:14445:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1788830672.602338:0:14445:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1788830672.602904:0:14445:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1788830672.602911:0:14445:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1788830672.603561:0:14445:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788830672.603927:0:14445:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1788830672.603933:0:14445:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1788830672.604442:0:14445:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1788830672.604449:0:14445:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1788830672.604887:0:14445:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1788830672.604894:0:14445:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1788830672.605428:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788830672.605431:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788830672.605433:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788830672.605916:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788830672.605919:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788830672.605921:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788830672.606627:0:14445:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1788830672.611340:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1788830672.618987:0:14445:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1788830672.619005:0:14445:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788830672.619008:0:14445:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:1.0:1788830672.621011:0:14454:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1788830672.621172:0:14445:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1788830672.621353:0:14445:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788830672.621959:0:14445:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1788830672.622983:0:14445:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788830672.623179:0:14445:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1788830672.623185:0:14445:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1788830672.626942:0:14445:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1788830672.626957:0:14445:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1788830672.627391:0:14445:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1788830672.627398:0:14445:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000100:00080000:2.0:1788830672.634093:0:14459:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:2.0:1788830672.634253:0:14445:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1788830672.634275:0:14445:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.201.121@tcp' 00000020:01000004:2.0:1788830672.634276:0:14445:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1788830672.634315:0:14445:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.201.121@tcp (typ=mgc) 00000020:00000080:2.0:1788830672.634330:0:14445:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.121@tcp (ffff9e25448299b8) 00000020:00000080:2.0:1788830672.634345:0:14445:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1788830672.634421:0:14445:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e25475db000@MGC192.168.201.121@tcp: add connection 192.168.201.121@tcp at head 00010000:00010000:2.0:1788830672.634649:0:14445:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.121@tcp-0 is initialized 00000040:01000000:2.0:1788830672.634656:0:14445:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.121@tcp ctxt 1 is initialized 10000000:01000000:2.0:1788830672.639037:0:14460:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1788830672.639117:0:14445:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.121@tcp (uuid 3689682b-484d-410c-a8fd-1b98c0369c65) 00000020:00000080:1.0:1788830672.639143:0:14445:0:(genops.c:1385:class_connect()) connect: client 3689682b-484d-410c-a8fd-1b98c0369c65, cookie 0x575506951eea1afc 00000100:00080000:1.0:1788830672.639156:0:14445:0:(import.c:510:import_select_connection()) MGC192.168.201.121@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788830672.639161:0:14445:0:(import.c:624:import_select_connection()) MGC192.168.201.121@tcp: import ffff9e25475db000 using connection 192.168.201.121@tcp/0@lo 00000100:00100000:1.0:1788830672.639197:0:14445:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e25747c2300 x1875724595186560/t0(0) o250->MGC192.168.201.121@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788830672.639216:0:14445:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 3689682b-484d-410c-a8fd-1b98c0369c65->MGS 00000100:00100000:3.0:1788830672.639341:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25747c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:3689682b-484d-410c-a8fd-1b98c0369c65:3306:1875724595186560:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1788830672.639449:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:1.0:1788830672.640070:0:14445:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000100:00100000:1.0:1788830672.640109:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595186560 00000100:00100000:1.0:1788830672.640117:0:14455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595186560 00000100:00100000:1.0:1788830672.640150:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788830672.640157:0:14455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2444ad4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3306:x1875724595186560:12345-0@lo:250:mount.lustre.0 00010000:00080000:1.0:1788830672.640179:0:14455:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 3689682b-484d-410c-a8fd-1b98c0369c65@0@lo t0 exp 0000000000000000 cur 425 last 0 00000020:00000080:1.0:1788830672.640204:0:14455:0:(genops.c:1385:class_connect()) connect: client 3689682b-484d-410c-a8fd-1b98c0369c65, cookie 0x575506951eea1b03 00000100:00080000:1.0:1788830672.642001:0:14455:0:(import.c:65:import_set_state_nolock()) ffff9e2565b5c000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788830672.642128:0:14455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2444ad4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3689682b-484d-410c-a8fd-1b98c0369c65+5:3306:x1875724595186560:12345-0@lo:250:mount.lustre.0 Request processed in 1970us (2678us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830672.642144:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000020:01000004:1.0:1788830672.642187:0:14445:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1788830672.642200:0:14445:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9e25474f19b8) 00000020:00000080:1.0:1788830672.642210:0:14445:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1788830672.650383:0:3306:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.201.121@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1788830672.650398:0:3306:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.201.121@tcp: connect to target with instance 0 00000100:00080000:3.0:1788830672.650406:0:3306:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.201.121@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1788830672.650412:0:3306:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1788830672.650416:0:3306:0:(import.c:65:import_set_state_nolock()) ffff9e25475db000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1788830672.650427:0:3306:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1788830672.650446:0:3306:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1788830672.650455:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25747c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:3689682b-484d-410c-a8fd-1b98c0369c65:3306:1875724595186560:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1788830672.658076:0:14445:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788830672.658304:0:14445:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1788830672.658311:0:14445:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1788830672.663034:0:14445:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1788830672.663046:0:14445:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1788830672.665138:0:14445:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1788830672.665149:0:14445:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1788830672.666119:0:14445:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788830672.666383:0:14445:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1788830672.666389:0:14445:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1788830672.667659:0:14445:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1788830672.667668:0:14445:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1788830672.714378:0:14445:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788830672.714594:0:14445:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1788830672.714600:0:14445:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1788830672.718115:0:14445:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1788830672.718135:0:14445:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1788830672.721205:0:14445:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788830672.721408:0:14445:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788830672.721415:0:14445:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1788830672.722149:0:14445:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788830672.722157:0:14445:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1788830672.723074:0:14445:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788830672.723238:0:14445:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788830672.723243:0:14445:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1788830672.724513:0:14445:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788830672.724525:0:14445:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1788830672.725137:0:14445:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788830672.725301:0:14445:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788830672.725306:0:14445:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1788830672.725645:0:14445:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788830672.725650:0:14445:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1788830672.741277:0:14445:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788830672.741505:0:14445:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788830672.741511:0:14445:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1788830672.743165:0:14445:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788830672.743177:0:14445:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1788830672.748873:0:14445:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788830672.748893:0:14445:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1788830672.752182:0:14445:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1788830672.752205:0:14445:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:1.0:1788830672.752211:0:14445:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.121@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1788830672.752348:0:14445:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.121@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788830672.752382:0:14445:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.121@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1788830672.752387:0:14445:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788830672.752389:0:14445:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788830672.752390:0:14445:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788830672.752391:0:14445:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788830672.752392:0:14445:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788830672.752394:0:14445:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788830672.752410:0:14445:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788830672.752411:0:14445:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788830672.752413:0:14445:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788830672.752414:0:14445:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788830672.752417:0:14445:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1788830672.752419:0:14445:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788830672.752420:0:14445:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788830672.752421:0:14445:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788830672.752422:0:14445:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788830672.752422:0:14445:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788830672.752423:0:14445:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788830672.752424:0:14445:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788830672.752425:0:14445:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788830672.752426:0:14445:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788830672.752427:0:14445:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788830672.752449:0:14445:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788830672.752469:0:14445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25747c3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3689682b-484d-410c-a8fd-1b98c0369c65:14445:1875724595186688:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788830672.752540:0:14445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830672.752593:0:14445:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e257f723cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788830672.753285:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595186688 00000100:00100000:3.0:1788830672.753293:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595186688 00000100:00100000:3.0:1788830672.753344:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788830672.753351:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2444ad7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3689682b-484d-410c-a8fd-1b98c0369c65+5:14445:x1875724595186688:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788830672.753391:0:14458:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788830672.753393:0:14458:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1788830672.753403:0:14458:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:0.0:1788830672.753733:0:14479:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1788830672.755662:0:14458:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:3.0:1788830672.757933:0:14480:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1788830672.757941:0:14480:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1788830672.757944:0:14480:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1788830672.757978:0:14480:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:0.0:1788830672.758298:0:14458:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788830672.758308:0:14458:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1788830672.764447:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2444ad7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3689682b-484d-410c-a8fd-1b98c0369c65+5:14445:x1875724595186688:12345-0@lo:253:mount.lustre.0 Request processed in 11085us (11896us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830672.764465:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788830672.764805:0:14445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25747c3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3689682b-484d-410c-a8fd-1b98c0369c65:14445:1875724595186688:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788830672.764821:0:14445:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788830672.764825:0:14445:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788830672.764826:0:14445:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788830672.764828:0:14445:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788830672.764829:0:14445:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788830672.764830:0:14445:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788830672.764831:0:14445:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788830672.764833:0:14445:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788830672.764834:0:14445:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788830672.764836:0:14445:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788830672.764837:0:14445:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788830672.764856:0:14445:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9e25460f8000 from lustre-MDT0000 10000000:01000000:1.0:1788830672.764880:0:14445:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1788830672.764883:0:14445:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788830672.764887:0:14445:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9e25448299b8 10000000:01000000:1.0:1788830672.764891:0:14445:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788830672.764909:0:14445:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9e25448299b8 from 1 10000000:01000000:1.0:1788830672.764912:0:14445:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788830672.764949:0:14445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.121@tcp lock: ffff9e257fa8d200/0x575506951eea1b11 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830672.764959:0:14445:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.121@tcp lock: ffff9e257fa8d200/0x575506951eea1b11 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830672.764969:0:14445:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.121@tcp lock: ffff9e257fa8d200/0x575506951eea1b11 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788830672.764989:0:14445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25747c3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3689682b-484d-410c-a8fd-1b98c0369c65:14445:1875724595186816:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788830672.766174:0:14445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830672.767143:0:14445:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e257f723840 going to sleep for 11 seconds 00000100:00100000:2.0:1788830672.770103:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595186816 00000100:00100000:2.0:1788830672.770118:0:14455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595186816 00000100:00100000:2.0:1788830672.770229:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788830672.770241:0:14455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2444ad6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3689682b-484d-410c-a8fd-1b98c0369c65+5:14445:x1875724595186816:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788830672.770257:0:14455:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788830672.770280:0:14455:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2565729c00/0x575506951eea1b18 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x575506951eea1b11 expref: -99 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830672.770308:0:14455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2565729c00/0x575506951eea1b18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x575506951eea1b11 expref: 6 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830672.770320:0:14455:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2565729c00/0x575506951eea1b18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x575506951eea1b11 expref: 6 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830672.770329:0:14455:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2565729c00, rc 0) 00000100:00100000:2.0:1788830672.770416:0:14455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2444ad6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3689682b-484d-410c-a8fd-1b98c0369c65+6:14445:x1875724595186816:12345-0@lo:101:mount.lustre.0 Request processed in 178us (4246us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830672.770436:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788830672.770534:0:14445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25747c3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3689682b-484d-410c-a8fd-1b98c0369c65:14445:1875724595186816:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788830672.770552:0:14445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.121@tcp lock: ffff9e257fa8d200/0x575506951eea1b11 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea1b18 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830672.770562:0:14445:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.121@tcp lock: ffff9e257fa8d200/0x575506951eea1b11 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x575506951eea1b18 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788830672.770632:0:14445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25747c3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3689682b-484d-410c-a8fd-1b98c0369c65:14445:1875724595186944:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788830672.770676:0:14445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830672.773976:0:14445:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e257f723840 going to sleep for 11 seconds 00000100:00100000:2.0:1788830672.774157:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595186944 00000100:00100000:2.0:1788830672.774167:0:14455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595186944 00000100:00100000:3.0:1788830672.774213:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788830672.774280:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2444ad6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3689682b-484d-410c-a8fd-1b98c0369c65+6:14445:x1875724595186944:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788830672.774536:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2444ad6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3689682b-484d-410c-a8fd-1b98c0369c65+6:14445:x1875724595186944:12345-0@lo:501:mount.lustre.0 Request processed in 260us (3870us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788830672.774543:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788830672.774627:0:14445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25747c3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3689682b-484d-410c-a8fd-1b98c0369c65:14445:1875724595186944:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788830672.774679:0:14445:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.121@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788830672.774698:0:14445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: ffff9e257fa8d200/0x575506951eea1b11 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea1b18 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830672.774768:0:14445:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.121@tcp lock: ffff9e257fa8d200/0x575506951eea1b11 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea1b18 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788830672.774777:0:14445:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9e25460f8000 10000000:01000000:1.0:1788830672.774808:0:14445:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788830672.774813:0:14445:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9e25460f8000 10000000:01000000:1.0:1788830672.774816:0:14445:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1788830672.774819:0:14445:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9e25460f8000 from 1 10000000:01000000:1.0:1788830672.774823:0:14445:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1788830672.774854:0:14445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.121@tcp lock: ffff9e257fa8c200/0x575506951eea1b1f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830672.774863:0:14445:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.121@tcp lock: ffff9e257fa8c200/0x575506951eea1b1f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830672.774872:0:14445:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.121@tcp lock: ffff9e257fa8c200/0x575506951eea1b1f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788830672.774891:0:14445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25747c3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3689682b-484d-410c-a8fd-1b98c0369c65:14445:1875724595187072:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788830672.774926:0:14445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830672.774954:0:14445:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e257f723840 going to sleep for 11 seconds 00000100:00100000:2.0:1788830672.775080:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595187072 00000100:00100000:2.0:1788830672.775165:0:14455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595187072 00000100:00100000:2.0:1788830672.775198:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788830672.775205:0:14455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2444872850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3689682b-484d-410c-a8fd-1b98c0369c65+6:14445:x1875724595187072:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788830672.775214:0:14455:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788830672.775308:0:14455:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2565728200/0x575506951eea1b26 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x575506951eea1b1f expref: -99 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830672.775331:0:14455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2565728200/0x575506951eea1b26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x575506951eea1b1f expref: 7 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830672.775342:0:14455:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2565728200/0x575506951eea1b26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x575506951eea1b1f expref: 7 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830672.775351:0:14455:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2565728200, rc 0) 00000100:00100000:2.0:1788830672.775400:0:14455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2444872850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3689682b-484d-410c-a8fd-1b98c0369c65+7:14445:x1875724595187072:12345-0@lo:101:mount.lustre.0 Request processed in 195us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830672.775406:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788830672.775785:0:14445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25747c3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3689682b-484d-410c-a8fd-1b98c0369c65:14445:1875724595187072:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788830672.775808:0:14445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.121@tcp lock: ffff9e257fa8c200/0x575506951eea1b1f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea1b26 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830672.775818:0:14445:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.121@tcp lock: ffff9e257fa8c200/0x575506951eea1b1f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x575506951eea1b26 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788830672.775908:0:14445:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.121@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1788830672.775923:0:14445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: ffff9e257fa8c200/0x575506951eea1b1f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea1b26 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830672.775929:0:14445:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.121@tcp lock: ffff9e257fa8c200/0x575506951eea1b1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea1b26 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788830672.775935:0:14445:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788830672.775939:0:14445:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788830672.775944:0:14445:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9e25460f8000 10000000:01000000:1.0:1788830672.775947:0:14445:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1788830672.775950:0:14445:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1788830672.775952:0:14445:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788830672.775967:0:14445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.121@tcp lock: ffff9e257fa8dc00/0x575506951eea1b2d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830672.775974:0:14445:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.121@tcp lock: ffff9e257fa8dc00/0x575506951eea1b2d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830672.775982:0:14445:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.121@tcp lock: ffff9e257fa8dc00/0x575506951eea1b2d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788830672.775996:0:14445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25747c3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3689682b-484d-410c-a8fd-1b98c0369c65:14445:1875724595187200:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788830672.776024:0:14445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830672.776044:0:14445:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e257f723840 going to sleep for 11 seconds 00000100:00100000:2.0:1788830672.776125:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595187200 00000100:00100000:2.0:1788830672.776129:0:14455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595187200 00000100:00100000:2.0:1788830672.776191:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788830672.776199:0:14455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2444873050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3689682b-484d-410c-a8fd-1b98c0369c65+7:14445:x1875724595187200:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788830672.776207:0:14455:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788830672.776216:0:14455:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2565729400/0x575506951eea1b34 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x575506951eea1b2d expref: -99 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830672.776242:0:14455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2565729400/0x575506951eea1b34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x575506951eea1b2d expref: 8 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830672.776250:0:14455:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2565729400/0x575506951eea1b34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x575506951eea1b2d expref: 8 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830672.776256:0:14455:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2565729400, rc 0) 00000100:00100000:2.0:1788830672.776293:0:14455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2444873050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3689682b-484d-410c-a8fd-1b98c0369c65+8:14445:x1875724595187200:12345-0@lo:101:mount.lustre.0 Request processed in 95us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830672.776299:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788830672.776411:0:14445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25747c3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3689682b-484d-410c-a8fd-1b98c0369c65:14445:1875724595187200:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788830672.776420:0:14445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.121@tcp lock: ffff9e257fa8dc00/0x575506951eea1b2d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea1b34 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830672.776435:0:14445:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.121@tcp lock: ffff9e257fa8dc00/0x575506951eea1b2d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x575506951eea1b34 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788830672.776481:0:14445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25747c3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3689682b-484d-410c-a8fd-1b98c0369c65:14445:1875724595187328:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788830672.776507:0:14445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830672.776660:0:14445:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e257f723840 going to sleep for 11 seconds 00000100:00100000:3.0:1788830672.776932:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595187328 00000100:00100000:3.0:1788830672.776938:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595187328 00000100:00100000:1.0:1788830672.777015:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788830672.777022:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2444870450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3689682b-484d-410c-a8fd-1b98c0369c65+8:14445:x1875724595187328:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788830672.777406:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2444870450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3689682b-484d-410c-a8fd-1b98c0369c65+9:14445:x1875724595187328:12345-0@lo:501:mount.lustre.0 Request processed in 374us (888us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830672.777414:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788830672.777998:0:14445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25747c3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3689682b-484d-410c-a8fd-1b98c0369c65:14445:1875724595187328:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788830672.778039:0:14445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2545cbea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3689682b-484d-410c-a8fd-1b98c0369c65:14445:1875724595187456:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788830672.778085:0:14445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830672.778118:0:14445:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2559a0d3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788830672.778162:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595187456 00000100:00100000:1.0:1788830672.778168:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595187456 00000100:00100000:1.0:1788830672.778190:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788830672.778198:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2444872450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3689682b-484d-410c-a8fd-1b98c0369c65+9:14445:x1875724595187456:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788830672.778496:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2444872450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3689682b-484d-410c-a8fd-1b98c0369c65+9:14445:x1875724595187456:12345-0@lo:503:mount.lustre.0 Request processed in 298us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830672.778504:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788830672.778603:0:14445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2545cbea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3689682b-484d-410c-a8fd-1b98c0369c65:14445:1875724595187456:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788830672.779044:0:14481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2545cbea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3689682b-484d-410c-a8fd-1b98c0369c65:14481:1875724595187584:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788830672.779081:0:14481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830672.779109:0:14481:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2559a0dd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788830672.779147:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595187584 00000100:00100000:1.0:1788830672.779152:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595187584 00000100:00100000:1.0:1788830672.779172:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788830672.779178:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2444872050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3689682b-484d-410c-a8fd-1b98c0369c65+9:14481:x1875724595187584:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788830672.779385:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2444872050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3689682b-484d-410c-a8fd-1b98c0369c65+9:14481:x1875724595187584:12345-0@lo:502:llog_process_th.0 Request processed in 206us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830672.779392:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788830672.779468:0:14481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2545cbea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3689682b-484d-410c-a8fd-1b98c0369c65:14481:1875724595187584:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788830672.779489:0:14481:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788830672.779499:0:14481:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788830672.779502:0:14481:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788830672.779507:0:14481:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1788830672.779510:0:14481:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788830672.779523:0:14481:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9e256601cd28) 00000020:00000080:3.0:1788830672.779538:0:14481:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1788830672.779545:0:14481:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788830672.779595:0:14481:0:(osd_handler.c:1573:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788830672.779600:0:14481:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x575506951eea1b42 00000020:00000080:3.0:1788830672.779835:0:14481:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1788830672.779845:0:14481:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788830672.779848:0:14481:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788830672.779849:0:14481:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788830672.779852:0:14481:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788830672.779855:0:14481:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788830672.779856:0:14481:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1788830672.779860:0:14481:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788830672.779867:0:14481:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9e2566018000) 00000020:00000080:3.0:1788830672.779877:0:14481:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1788830672.779892:0:14481:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788830672.779894:0:14481:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1788830672.779897:0:14481:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1788830672.779904:0:14481:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788830672.779936:0:14481:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e25460f8000 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1788830672.779946:0:14481:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9e25660199b8) 00000020:00000080:3.0:1788830672.779951:0:14481:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1788830672.779988:0:14481:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788830672.779992:0:14481:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x575506951eea1b57 00000020:00000080:3.0:1788830672.780076:0:14481:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1788830672.780082:0:14481:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788830672.780087:0:14481:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x575506951eea1b5e 00080000:01000000:3.0:1788830672.780093:0:14481:0:(osd_handler.c:1573:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788830672.780095:0:14481:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x575506951eea1b65 00010000:00010000:2.0:1788830672.846213:0:14481:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1788830672.846863:0:14481:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967524 00000001:00080000:2.0:1788830672.847143:0:14481:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1788830672.847926:0:14481:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9e254482b370) 00000020:00000080:2.0:1788830672.847944:0:14481:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1788830672.848014:0:14481:0:(osd_handler.c:1573:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788830672.848021:0:14481:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x575506951eea1b73 00000020:00000080:1.0:1788830672.848783:0:14481:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1788830672.858855:0:14481:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x575506951eea1b7a 00000020:00000080:3.0:1788830672.864261:0:14481:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1788830672.864274:0:14481:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788830672.864292:0:14481:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788830672.864294:0:14481:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1788830672.864297:0:14481:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788830672.864300:0:14481:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:3.0:1788830672.864301:0:14481:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788830672.864303:0:14481:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788830672.864304:0:14481:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788830672.864306:0:14481:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788830672.864308:0:14481:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788830672.864321:0:14481:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788830672.864326:0:14481:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788830672.864327:0:14481:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1788830672.864332:0:14481:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1788830672.864375:0:14481:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1788830672.864387:0:14481:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788830672.864389:0:14481:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788830672.864391:0:14481:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1788830672.864393:0:14481:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788830672.864397:0:14481:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1788830672.864399:0:14481:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788830672.864401:0:14481:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1788830672.864403:0:14481:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788830672.864408:0:14481:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.121@tcp to nid 0x20000c0a8c979 (192.168.201.121@tcp) 00000020:01000000:3.0:1788830672.864435:0:14481:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788830672.864437:0:14481:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788830672.864450:0:14481:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9e256601b370) 00000020:00000080:3.0:1788830672.864476:0:14481:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:3.0:1788830672.864482:0:14481:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788830672.864531:0:14481:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1788830672.864536:0:14481:0:(osd_handler.c:1573:osd_obd_connect()) connect #5 00000020:00000080:3.0:1788830672.864542:0:14481:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x575506951eea1b88 00010000:00080000:3.0:1788830672.864575:0:14481:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e2548331000@lustre-OST0000-osc-MDT0000: add connection 192.168.201.121@tcp at head 00010000:00010000:3.0:1788830672.864840:0:14481:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:3.0:1788830672.865306:0:14481:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788830672.865349:0:14481:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1788830672.866277:0:14481:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788830672.866345:0:14481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:3.0:1788830672.866416:0:14481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:3.0:1788830672.867255:0:14485:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788830672.867261:0:14485:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1788830672.868313:0:14481:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788830672.868325:0:14481:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788830672.868358:0:14481:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788830672.868377:0:14481:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x575506951eea1b8f 00000100:00080000:1.0:1788830672.868387:0:14481:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788830672.868393:0:14481:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9e2548331000 using connection 192.168.201.121@tcp/0@lo 00000100:00100000:1.0:1788830672.868428:0:14481:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e25747c2680 x1875724595187712/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788830672.868506:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25747c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1875724595187712:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1788830672.868564:0:3306:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875724595187712 offset 0 length 520: 4 00000100:00080000:1.0:1788830672.868677:0:14481:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1788830672.868880:0:14481:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788830672.868884:0:14481:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788830672.868886:0:14481:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1788830672.868889:0:14481:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788830672.868892:0:14481:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:1.0:1788830672.868894:0:14481:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788830672.868895:0:14481:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788830672.868896:0:14481:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788830672.868899:0:14481:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788830672.868900:0:14481:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788830672.868903:0:14481:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788830672.868908:0:14481:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1788830672.868911:0:14481:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788830672.868912:0:14481:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1788830672.868915:0:14481:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788830672.868919:0:14481:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.121@tcp to nid 0x20000c0a8c979 (192.168.201.121@tcp) 00000020:01000000:1.0:1788830672.868940:0:14481:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788830672.868943:0:14481:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788830672.868956:0:14481:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9e25474f4d28) 00000020:00000080:1.0:1788830672.868969:0:14481:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:1.0:1788830672.868983:0:14481:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788830672.869128:0:14481:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1788830672.869134:0:14481:0:(osd_handler.c:1573:osd_obd_connect()) connect #6 00000020:00000080:1.0:1788830672.869141:0:14481:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x575506951eea1b9d 00010000:00080000:1.0:1788830672.869170:0:14481:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e25430e7800@lustre-OST0001-osc-MDT0000: add connection 192.168.201.121@tcp at head 00010000:00010000:1.0:1788830672.869441:0:14481:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:1.0:1788830672.871146:0:14481:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788830672.871173:0:14481:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788830672.872174:0:14481:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788830672.873766:0:14481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:1.0:1788830672.873899:0:14481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:1.0:1788830672.874642:0:14487:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788830672.874648:0:14487:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1788830672.875950:0:14481:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788830672.875962:0:14481:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788830672.875993:0:14481:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788830672.876008:0:14481:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x575506951eea1ba4 00000100:00080000:0.0:1788830672.876017:0:14481:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788830672.876022:0:14481:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9e25430e7800 using connection 192.168.201.121@tcp/0@lo 00000100:00100000:0.0:1788830672.876061:0:14481:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e25478b4e00 x1875724595187840/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788830672.876082:0:14481:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1788830672.876137:0:14481:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788830672.876141:0:14481:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788830672.876144:0:14481:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1788830672.876148:0:14481:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788830672.876152:0:14481:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788830672.876153:0:14481:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788830672.876156:0:14481:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788830672.876158:0:14481:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788830672.876161:0:14481:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788830672.876163:0:14481:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788830672.876164:0:14481:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788830672.876167:0:14481:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788830672.876169:0:14481:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788830672.876170:0:14481:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788830672.876174:0:14481:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788830672.876202:0:14481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25478b4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3689682b-484d-410c-a8fd-1b98c0369c65:14481:1875724595187968:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788830672.876269:0:14481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830672.876311:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595187968 00000100:00100000:0.0:1788830672.876311:0:14481:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e24469d4180 going to sleep for 11 seconds 00000100:00100000:1.0:1788830672.876319:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595187968 00000100:00100000:1.0:1788830672.876368:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788830672.876378:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e254737fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3689682b-484d-410c-a8fd-1b98c0369c65+9:14481:x1875724595187968:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788830672.876689:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e254737fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3689682b-484d-410c-a8fd-1b98c0369c65+9:14481:x1875724595187968:12345-0@lo:502:llog_process_th.0 Request processed in 312us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830672.876698:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788830672.876750:0:14481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25478b4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3689682b-484d-410c-a8fd-1b98c0369c65:14481:1875724595187968:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788830672.876774:0:14481:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788830672.876778:0:14481:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788830672.876779:0:14481:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788830672.876781:0:14481:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:1.0:1788830672.876932:0:14445:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:1.0:1788830672.876959:0:14445:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.121@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788830672.876979:0:14445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: ffff9e257fa8dc00/0x575506951eea1b2d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea1b34 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830672.876991:0:14445:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.121@tcp lock: ffff9e257fa8dc00/0x575506951eea1b2d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea1b34 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788830672.877010:0:14445:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9e25460f8000 from 1 10000000:01000000:1.0:1788830672.877013:0:14445:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788830672.877046:0:14445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.121@tcp lock: ffff9e257fa8de00/0x575506951eea1bab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830672.877055:0:14445:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.121@tcp lock: ffff9e257fa8de00/0x575506951eea1bab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830672.877064:0:14445:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.121@tcp lock: ffff9e257fa8de00/0x575506951eea1bab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788830672.877079:0:14445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25747c2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3689682b-484d-410c-a8fd-1b98c0369c65:14445:1875724595188096:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788830672.877106:0:14445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830672.877138:0:14445:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2545d2c0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788830672.877138:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595188096 00000100:00100000:0.0:1788830672.877144:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595188096 00000100:00100000:0.0:1788830672.877166:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788830672.877172:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e254737e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3689682b-484d-410c-a8fd-1b98c0369c65+9:14445:x1875724595188096:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788830672.877185:0:14457:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788830672.877197:0:14457:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e25658d6c00/0x575506951eea1bb2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x575506951eea1bab expref: -99 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830672.877214:0:14457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e25658d6c00/0x575506951eea1bb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x575506951eea1bab expref: 10 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830672.877221:0:14457:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e25658d6c00/0x575506951eea1bb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x575506951eea1bab expref: 10 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830672.877228:0:14457:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e25658d6c00, rc 0) 00000100:00100000:0.0:1788830672.877291:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e254737e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3689682b-484d-410c-a8fd-1b98c0369c65+10:14445:x1875724595188096:12345-0@lo:101:mount.lustre.0 Request processed in 119us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830672.877296:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788830672.877394:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25478b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1875724595187840:0@lo:8:llog_process_th.0 00000100:00100000:1.0:1788830672.877401:0:14445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25747c2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3689682b-484d-410c-a8fd-1b98c0369c65:14445:1875724595188096:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788830672.877410:0:14445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.121@tcp lock: ffff9e257fa8de00/0x575506951eea1bab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea1bb2 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830672.877416:0:14445:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.121@tcp lock: ffff9e257fa8de00/0x575506951eea1bab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x575506951eea1bb2 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000400:00000100:3.0:1788830672.877429:0:3306:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875724595187840 offset 0 length 520: 4 00000100:00100000:1.0:1788830672.879253:0:14445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25747c2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3689682b-484d-410c-a8fd-1b98c0369c65:14445:1875724595188224:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1788830672.879303:0:14445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830672.879346:0:14445:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2545d2c0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788830672.879370:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595188224 00000100:00100000:2.0:1788830672.879378:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595188224 00000100:00100000:2.0:1788830672.879421:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788830672.879431:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e254737dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3689682b-484d-410c-a8fd-1b98c0369c65+10:14445:x1875724595188224:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1788830672.879448:0:14458:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1788830672.879454:0:14458:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1788830672.879548:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e254737dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3689682b-484d-410c-a8fd-1b98c0369c65+10:14445:x1875724595188224:12345-0@lo:256:mount.lustre.0 Request processed in 118us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830672.879556:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788830672.879560:0:14445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25747c2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3689682b-484d-410c-a8fd-1b98c0369c65:14445:1875724595188224:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1788830672.880099:0:14445:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.121@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788830672.880118:0:14445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: ffff9e257fa8de00/0x575506951eea1bab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea1bb2 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830672.880128:0:14445:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.121@tcp lock: ffff9e257fa8de00/0x575506951eea1bab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea1bb2 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788830672.880188:0:14445:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e25460f8000 from 1 10000000:01000000:1.0:1788830672.880191:0:14445:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788830672.880217:0:14445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.121@tcp lock: ffff9e257fa8c600/0x575506951eea1bb9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830672.880225:0:14445:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.121@tcp lock: ffff9e257fa8c600/0x575506951eea1bb9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830672.880235:0:14445:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.121@tcp lock: ffff9e257fa8c600/0x575506951eea1bb9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788830672.880250:0:14445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25747c2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3689682b-484d-410c-a8fd-1b98c0369c65:14445:1875724595188352:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788830672.880280:0:14445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830672.880313:0:14445:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2545d2c0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788830672.880389:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595188352 00000100:00100000:2.0:1788830672.880403:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595188352 00000100:00100000:2.0:1788830672.880442:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788830672.880449:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e254737c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3689682b-484d-410c-a8fd-1b98c0369c65+10:14445:x1875724595188352:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788830672.880458:0:14457:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788830672.880482:0:14457:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2565729800/0x575506951eea1bc0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x575506951eea1bb9 expref: -99 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830672.880502:0:14457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2565729800/0x575506951eea1bc0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x575506951eea1bb9 expref: 11 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830672.880512:0:14457:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2565729800/0x575506951eea1bc0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x575506951eea1bb9 expref: 11 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830672.880521:0:14457:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2565729800, rc 0) 00000100:00100000:2.0:1788830672.880554:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e254737c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3689682b-484d-410c-a8fd-1b98c0369c65+11:14445:x1875724595188352:12345-0@lo:101:mount.lustre.0 Request processed in 105us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830672.880561:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788830672.880571:0:14445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25747c2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3689682b-484d-410c-a8fd-1b98c0369c65:14445:1875724595188352:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788830672.880587:0:14445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.121@tcp lock: ffff9e257fa8c600/0x575506951eea1bb9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea1bc0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830672.880597:0:14445:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.121@tcp lock: ffff9e257fa8c600/0x575506951eea1bb9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x575506951eea1bc0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788830672.880658:0:14445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25747c2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3689682b-484d-410c-a8fd-1b98c0369c65:14445:1875724595188480:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788830672.880696:0:14445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788830672.880805:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595188480 00000100:00100000:2.0:1788830672.880810:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595188480 00000100:00100000:2.0:1788830672.880845:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788830672.880851:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e254737d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3689682b-484d-410c-a8fd-1b98c0369c65+11:14445:x1875724595188480:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788830672.880937:0:14445:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2545d2c0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788830672.881585:0:14445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25747c2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3689682b-484d-410c-a8fd-1b98c0369c65:14445:1875724595188480:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788830672.881586:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e254737d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3689682b-484d-410c-a8fd-1b98c0369c65+11:14445:x1875724595188480:12345-0@lo:501:mount.lustre.0 Request processed in 731us (886us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830672.881599:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788830672.881640:0:14445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25747c2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3689682b-484d-410c-a8fd-1b98c0369c65:14445:1875724595188608:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788830672.881697:0:14445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788830672.881920:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595188608 00000100:00100000:2.0:1788830672.881925:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595188608 00000100:00100000:1.0:1788830672.881939:0:14445:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2545d2c0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788830672.881963:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788830672.881971:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e254737f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3689682b-484d-410c-a8fd-1b98c0369c65+11:14445:x1875724595188608:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788830672.882354:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e254737f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3689682b-484d-410c-a8fd-1b98c0369c65+11:14445:x1875724595188608:12345-0@lo:503:mount.lustre.0 Request processed in 383us (657us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830672.882361:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788830672.882388:0:14445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25747c2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3689682b-484d-410c-a8fd-1b98c0369c65:14445:1875724595188608:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788830672.882653:0:14489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25658c3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3689682b-484d-410c-a8fd-1b98c0369c65:14489:1875724595188736:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788830672.882690:0:14489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830672.882731:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595188736 00000100:00100000:1.0:1788830672.882736:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595188736 00000100:00100000:1.0:1788830672.882767:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788830672.882775:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e254737d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3689682b-484d-410c-a8fd-1b98c0369c65+11:14489:x1875724595188736:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788830672.882927:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e254737d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3689682b-484d-410c-a8fd-1b98c0369c65+11:14489:x1875724595188736:12345-0@lo:502:llog_process_th.0 Request processed in 152us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830672.882930:0:14489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e25480349c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788830672.882934:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788830672.882951:0:14489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25658c3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3689682b-484d-410c-a8fd-1b98c0369c65:14489:1875724595188736:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788830672.882977:0:14489:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788830672.882987:0:14489:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788830672.882989:0:14489:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788830672.882996:0:14489:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e25460f8000 00000020:00000080:2.0:1788830672.883073:0:14489:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788830672.883081:0:14489:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788830672.883084:0:14489:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788830672.883086:0:14489:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788830672.883088:0:14489:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788830672.883091:0:14489:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788830672.883092:0:14489:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788830672.883095:0:14489:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e25460f8000 00000020:00000080:2.0:1788830672.883097:0:14489:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788830672.883150:0:14489:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788830672.883153:0:14489:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788830672.883155:0:14489:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788830672.883158:0:14489:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788830672.883161:0:14489:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788830672.883163:0:14489:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788830672.883166:0:14489:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9e25460f8000 00000020:00000080:2.0:1788830672.883168:0:14489:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788830672.883199:0:14489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25658c3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3689682b-484d-410c-a8fd-1b98c0369c65:14489:1875724595188864:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788830672.883316:0:14489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788830672.883382:0:14489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e25480349c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788830672.883419:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595188864 00000100:00100000:0.0:1788830672.883424:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595188864 00000100:00100000:0.0:1788830672.883507:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788830672.883517:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e254737e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3689682b-484d-410c-a8fd-1b98c0369c65+11:14489:x1875724595188864:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788830672.883675:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e254737e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3689682b-484d-410c-a8fd-1b98c0369c65+11:14489:x1875724595188864:12345-0@lo:502:llog_process_th.0 Request processed in 160us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830672.883682:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788830672.883824:0:14489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25658c3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3689682b-484d-410c-a8fd-1b98c0369c65:14489:1875724595188864:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788830672.883845:0:14489:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788830672.883850:0:14489:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788830672.883852:0:14489:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1788830672.883856:0:14489:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1788830672.885696:0:14445:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1788830672.885749:0:14445:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788830672.885772:0:14445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: ffff9e257fa8c600/0x575506951eea1bb9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea1bc0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830672.885797:0:14445:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.121@tcp lock: ffff9e257fa8c600/0x575506951eea1bb9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea1bc0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788830672.885840:0:14445:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788830672.885843:0:14445:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9e25460f8000 10000000:01000000:1.0:1788830672.885845:0:14445:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9e25460f8000 10000000:01000000:1.0:1788830672.885849:0:14445:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788830672.885853:0:14445:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9e25460f8000 from 1 10000000:01000000:1.0:1788830672.885855:0:14445:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788830672.885883:0:14445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.121@tcp lock: ffff9e257fa8ca00/0x575506951eea1bc7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830672.885889:0:14445:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.121@tcp lock: ffff9e257fa8ca00/0x575506951eea1bc7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830672.885904:0:14445:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.121@tcp lock: ffff9e257fa8ca00/0x575506951eea1bc7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788830672.885922:0:14445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25747c2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3689682b-484d-410c-a8fd-1b98c0369c65:14445:1875724595188992:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788830672.885973:0:14445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830672.892100:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595188992 00000100:00100000:3.0:1788830672.892114:0:14455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595188992 00000100:00100000:0.0:1788830672.892290:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788830672.892309:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e254737f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3689682b-484d-410c-a8fd-1b98c0369c65+11:14445:x1875724595188992:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788830672.892326:0:14457:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1788830672.892329:0:14445:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2545d2ce40 going to sleep for 11 seconds 00010000:00010000:0.0:1788830672.892345:0:14457:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e25658d7400/0x575506951eea1bce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x575506951eea1bc7 expref: -99 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830672.892377:0:14457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e25658d7400/0x575506951eea1bce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x575506951eea1bc7 expref: 12 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830672.892398:0:14457:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e25658d7400/0x575506951eea1bce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x575506951eea1bc7 expref: 12 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830672.892407:0:14457:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e25658d7400, rc 0) 00000100:00100000:0.0:1788830672.893421:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e254737f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3689682b-484d-410c-a8fd-1b98c0369c65+12:14445:x1875724595188992:12345-0@lo:101:mount.lustre.0 Request processed in 1115us (7445us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830672.893430:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788830672.898365:0:14445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25747c2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3689682b-484d-410c-a8fd-1b98c0369c65:14445:1875724595188992:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788830672.898399:0:14445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.121@tcp lock: ffff9e257fa8ca00/0x575506951eea1bc7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea1bce expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830672.898411:0:14445:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.121@tcp lock: ffff9e257fa8ca00/0x575506951eea1bc7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x575506951eea1bce expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788830672.899344:0:14445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2545cbea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3689682b-484d-410c-a8fd-1b98c0369c65:14445:1875724595189120:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788830672.899414:0:14445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830672.899461:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595189120 00000100:00100000:1.0:1788830672.899468:0:14455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595189120 00000100:00100000:1.0:1788830672.899508:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788830672.899515:0:14455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e254737c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3689682b-484d-410c-a8fd-1b98c0369c65+12:14445:x1875724595189120:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788830672.899804:0:14445:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2545cc9f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788830672.899814:0:14455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e254737c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3689682b-484d-410c-a8fd-1b98c0369c65+12:14445:x1875724595189120:12345-0@lo:501:mount.lustre.0 Request processed in 297us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830672.899821:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788830672.899828:0:14445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2545cbea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3689682b-484d-410c-a8fd-1b98c0369c65:14445:1875724595189120:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788830672.899868:0:14445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2545cbea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3689682b-484d-410c-a8fd-1b98c0369c65:14445:1875724595189248:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788830672.899910:0:14445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830672.899934:0:14445:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2545cc9f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788830672.899955:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595189248 00000100:00100000:3.0:1788830672.899959:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595189248 00000100:00100000:3.0:1788830672.899991:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788830672.900547:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e254737d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3689682b-484d-410c-a8fd-1b98c0369c65+12:14445:x1875724595189248:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788830672.900755:0:14445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2545cbea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3689682b-484d-410c-a8fd-1b98c0369c65:14445:1875724595189248:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788830672.901148:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e254737d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3689682b-484d-410c-a8fd-1b98c0369c65+12:14445:x1875724595189248:12345-0@lo:503:mount.lustre.0 Request processed in 171us (802us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830672.901165:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788830672.904184:0:14494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2545cbd500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3689682b-484d-410c-a8fd-1b98c0369c65:14494:1875724595189376:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788830672.904259:0:14494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830672.904298:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595189376 00000100:00100000:3.0:1788830672.904305:0:14494:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e257fc23000 going to sleep for 11 seconds 00000100:00100000:1.0:1788830672.904305:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595189376 00000100:00100000:1.0:1788830672.904349:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788830672.904356:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e24451ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3689682b-484d-410c-a8fd-1b98c0369c65+12:14494:x1875724595189376:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788830672.904615:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e24451ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3689682b-484d-410c-a8fd-1b98c0369c65+12:14494:x1875724595189376:12345-0@lo:502:llog_process_th.0 Request processed in 258us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830672.904623:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788830672.904775:0:14494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2545cbd500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3689682b-484d-410c-a8fd-1b98c0369c65:14494:1875724595189376:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1788830672.904842:0:14494:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1788830672.904857:0:14494:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9e2547ae3370) 00000020:00000080:3.0:1788830672.904875:0:14494:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:3.0:1788830672.904949:0:14494:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e25460f8000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788830672.904953:0:14494:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e25460f8000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788830672.904956:0:14494:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e25460f8000 4 00010000:00080000:3.0:1788830672.904990:0:14494:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e2544820800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.121@tcp at head 00010000:00010000:2.0:1788830672.907799:0:14494:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:2.0:1788830672.908017:0:14494:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1788830672.908060:0:14494:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788830672.908076:0:14494:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x575506951eea1bdc 00000100:00080000:2.0:1788830672.908090:0:14494:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788830672.908097:0:14494:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9e2544820800 using connection 192.168.201.121@tcp/0@lo 00000100:00100000:2.0:1788830672.908151:0:14494:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e25658c3b80 x1875724595189504/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788830672.908184:0:14494:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788830672.909084:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25658c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875724595189504:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788830672.909161:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830672.909541:0:14463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595189504 00000100:00100000:3.0:1788830672.909550:0:14463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595189504 00000100:00100000:3.0:1788830672.909583:0:14463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788830672.909591:0:14463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25478b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3306:x1875724595189504:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788830672.909649:0:14463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25478b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3306:x1875724595189504:12345-0@lo:38:llog_process_th.0 Request processed in 57us (488us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788830672.909657:0:14463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788830672.909699:0:3306:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788830672.909706:0:3306:0:(import.c:65:import_set_state_nolock()) ffff9e2544820800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788830672.909737:0:3306:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788830672.909741:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25658c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875724595189504:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788830672.909856:0:14494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25658c3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3689682b-484d-410c-a8fd-1b98c0369c65:14494:1875724595189632:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788830672.909903:0:14494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788830672.909937:0:14494:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2548034600 going to sleep for 11 seconds 00000100:00100000:3.0:1788830672.910749:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595189632 00000100:00100000:3.0:1788830672.910757:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595189632 00000100:00100000:3.0:1788830672.910804:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788830672.910819:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e24451c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3689682b-484d-410c-a8fd-1b98c0369c65+12:14494:x1875724595189632:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788830672.911070:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e24451c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3689682b-484d-410c-a8fd-1b98c0369c65+12:14494:x1875724595189632:12345-0@lo:502:llog_process_th.0 Request processed in 251us (1165us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830672.911078:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788830672.911407:0:14494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25658c3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3689682b-484d-410c-a8fd-1b98c0369c65:14494:1875724595189632:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1788830672.911440:0:14494:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1788830672.911532:0:14445:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1788830672.911555:0:14445:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.121@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788830672.911571:0:14445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: ffff9e257fa8ca00/0x575506951eea1bc7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea1bce expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830672.911582:0:14445:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.121@tcp lock: ffff9e257fa8ca00/0x575506951eea1bc7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea1bce expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788830672.911628:0:14445:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788830672.911630:0:14445:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788830672.911631:0:14445:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788830672.911632:0:14445:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788830672.911634:0:14445:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788830672.911635:0:14445:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788830672.911636:0:14445:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788830672.911638:0:14445:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788830672.911639:0:14445:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788830672.911641:0:14445:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788830672.911644:0:14445:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:3.0:1788830672.911647:0:14445:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788830672.911648:0:14445:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788830672.911650:0:14445:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788830672.911651:0:14445:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788830672.911653:0:14445:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788830672.911654:0:14445:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788830672.911655:0:14445:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788830672.911657:0:14445:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788830672.911658:0:14445:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788830672.911659:0:14445:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788830672.911674:0:14445:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788830672.911689:0:14445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2545cbd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3689682b-484d-410c-a8fd-1b98c0369c65:14445:1875724595189760:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788830672.911744:0:14445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830672.911766:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595189760 00000100:00100000:1.0:1788830672.911771:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595189760 00000100:00100000:3.0:1788830672.911772:0:14445:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e257fc23300 going to sleep for 11 seconds 00000100:00100000:3.0:1788830672.911814:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788830672.911823:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e24451cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3689682b-484d-410c-a8fd-1b98c0369c65+12:14445:x1875724595189760:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788830672.911851:0:14458:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788830672.911862:0:14458:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788830672.951907:0:14458:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788830672.951932:0:14458:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1788830672.953327:0:14479:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788830672.953335:0:14479:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788830672.953359:0:14479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2565729000/0x575506951eea1be3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830672.953378:0:14479:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e25658d6c00/0x575506951eea1bb2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x575506951eea1bab expref: 12 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830672.953403:0:14479:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2565729000/0x575506951eea1be3 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830672.953444:0:14479:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e25658d6c00/0x575506951eea1bb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x575506951eea1bab expref: 12 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830672.953458:0:14479:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e25658d6c00/0x575506951eea1bb2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x575506951eea1bab expref: 12 pid: 14457 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788830672.953538:0:14479:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25658c3b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14479:1875724595189888:0@lo:104: 00000100:00100000:2.0:1788830672.953603:0:14479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788830672.953647:0:14479:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e255385d300 going to sleep for 11 seconds 00000100:00100000:3.0:1788830672.953760:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595189888 00000100:00100000:3.0:1788830672.953767:0:14446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595189888 00000100:00100000:3.0:1788830672.953821:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788830672.953831:0:14446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25658c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3689682b-484d-410c-a8fd-1b98c0369c65+3:14479:x1875724595189888:12345-0@lo:104: 00010000:00010000:3.0:1788830672.953844:0:14446:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.121@tcp lock: ffff9e257fa8de00/0x575506951eea1bab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x575506951eea1bb2 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830672.954539:0:14446:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788830672.954549:0:14446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25658c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3689682b-484d-410c-a8fd-1b98c0369c65+3:14479:x1875724595189888:12345-0@lo:104: Request processed in 717us (943us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830672.954557:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788830672.955086:0:14479:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25658c3b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14479:1875724595189888:0@lo:104: 00010000:00010000:2.0:1788830672.955110:0:14479:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2565729000/0x575506951eea1be3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830672.957220:0:14452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788830672.957234:0:14452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.121@tcp lock: ffff9e257fa8de00/0x575506951eea1bab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x575506951eea1bb2 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830672.957245:0:14452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e257fa8de00 already unused, calling callback (ffffffffc1aebc20) 10000000:00010000:0.0:1788830672.957251:0:14452:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.121@tcp lock: ffff9e257fa8de00/0x575506951eea1bab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x575506951eea1bb2 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830672.957261:0:14452:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.121@tcp lock: ffff9e257fa8de00/0x575506951eea1bab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x575506951eea1bb2 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788830672.957268:0:14452:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.121@tcp lock: ffff9e257fa8de00/0x575506951eea1bab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x575506951eea1bb2 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788830672.957273:0:14452:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788830672.957332:0:14452:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.121@tcp lock: ffff9e257fa8de00/0x575506951eea1bab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x575506951eea1bb2 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830672.957339:0:14452:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788830672.957374:0:14452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.121@tcp lock: ffff9e257fa8de00/0x575506951eea1bab lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x575506951eea1bb2 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830672.957382:0:14452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.121@tcp lock: ffff9e257fa8de00/0x575506951eea1bab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x575506951eea1bb2 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830672.957400:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788830672.957401:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788830672.957403:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788830672.957594:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25478b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3689682b-484d-410c-a8fd-1b98c0369c65:3307:1875724595190016:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788830672.957674:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788830672.958044:0:14448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595190016 00000100:00100000:2.0:1788830672.958052:0:14448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595190016 00010000:00010000:2.0:1788830672.958082:0:14448:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e25658d6c00/0x575506951eea1bb2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x575506951eea1bab expref: 13 pid: 14457 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788830672.958119:0:14448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788830672.958128:0:14448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2545cbf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3689682b-484d-410c-a8fd-1b98c0369c65+13:3307:x1875724595190016:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788830672.958139:0:14448:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788830672.958145:0:14448:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e25658d6c00/0x575506951eea1bb2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x575506951eea1bab expref: 13 pid: 14457 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830672.958156:0:14448:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e25658d6c00/0x575506951eea1bb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x575506951eea1bab expref: 13 pid: 14457 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830672.958180:0:14448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e25658d6c00/0x575506951eea1bb2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x575506951eea1bab expref: 13 pid: 14457 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830672.958193:0:14448:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2565729000/0x575506951eea1be3 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830672.958201:0:14448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2565729000/0x575506951eea1be3 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788830672.958216:0:14448:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004882318s 00010000:00010000:2.0:1788830672.958221:0:14448:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2565729000/0x575506951eea1be3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830672.958228:0:14448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2565729000/0x575506951eea1be3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830672.958235:0:14448:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2565729000/0x575506951eea1be3 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830672.958241:0:14448:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2565729000/0x575506951eea1be3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830672.958247:0:14448:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2565729000 already unused, calling callback (ffffffffc14cb350) 00010000:00010000:2.0:1788830672.958251:0:14448:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2565729000/0x575506951eea1be3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830672.958259:0:14448:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2565729000/0x575506951eea1be3 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830672.958274:0:14448:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2565729000/0x575506951eea1be3 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830672.958290:0:14448:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788830672.958332:0:14448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2545cbf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3689682b-484d-410c-a8fd-1b98c0369c65+12:3307:x1875724595190016:12345-0@lo:103:ldlm_bl.0 Request processed in 204us (657us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830672.958339:0:14448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1788830672.958363:0:14479:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2565729000/0x575506951eea1be3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830672.958370:0:14479:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2565729000/0x575506951eea1be3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830672.958375:0:14479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2565729000/0x575506951eea1be3 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788830672.958885:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25478b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3689682b-484d-410c-a8fd-1b98c0369c65:3307:1875724595190016:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788830672.959589:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e24451cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3689682b-484d-410c-a8fd-1b98c0369c65+11:14445:x1875724595189760:12345-0@lo:253:mount.lustre.0 Request processed in 47765us (47842us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830672.959598:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788830672.959860:0:14445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2545cbd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3689682b-484d-410c-a8fd-1b98c0369c65:14445:1875724595189760:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788830672.959872:0:14445:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788830672.959875:0:14445:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788830672.959877:0:14445:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788830672.959879:0:14445:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788830672.959880:0:14445:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788830672.959881:0:14445:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788830672.959882:0:14445:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788830672.959884:0:14445:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788830672.959885:0:14445:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788830672.959887:0:14445:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788830672.959889:0:14445:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788830672.959900:0:14445:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1788830672.965387:0:14445:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:1.0:1788830672.965631:0:14445:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1788830672.966149:0:14445:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:1.0:1788830672.966302:0:14445:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1788830672.966651:0:14445:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:1.0:1788830672.966993:0:14445:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:1.0:1788830672.967901:0:14445:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:1.0:1788830672.968068:0:14445:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:1.0:1788830672.968329:0:14445:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:1.0:1788830672.968692:0:14445:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:1.0:1788830672.969248:0:14445:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:1.0:1788830672.969395:0:14445:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:1.0:1788830672.988942:0:14445:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:1.0:1788830672.989291:0:14445:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:0.0:1788830672.989350:0:14499:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:0.0:1788830672.989354:0:14499:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:0.0:1788830672.989606:0:14500:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:0.0:1788830672.989684:0:14500:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788830672.991781:0:14500:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788830672.991871:0:14500:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1788830672.991876:0:14500:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:1.0:1788830672.993958:0:14445:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1788830672.994071:0:14445:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1788830672.994477:0:14445:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1788830672.994486:0:14445:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1788830672.994609:0:14445:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788830672.995601:0:14445:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1788830672.996610:0:14445:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1788830672.996892:0:14445:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1788830672.997365:0:14445:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 0, last_idx 1 00080000:10000000:0.0:1788830672.998458:0:14445:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:2.0:1788830673.006462:0:14445:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:2.0:1788830673.030508:0:14445:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1788830673.030557:0:14445:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb658c1cc3988 00100000:10000000:2.0:1788830673.030564:0:14445:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1788830673.031277:0:14445:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788830673.031293:0:14445:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.121@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788830673.031305:0:14445:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1788830673.031331:0:14445:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:3.0:1788830673.631683:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788830673.948246:0:14495:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788830673.948256:0:14495:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788830673.949536:0:14495:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:1.0:1788830673.949546:0:14495:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 10000000:01000000:3.0:1788830674.271950:0:14460:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788830674.271958:0:14460:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9e25460f8000 from 6 10000000:01000000:3.0:1788830674.271963:0:14460:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788830674.272008:0:14460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.121@tcp lock: ffff9e257d945400/0x575506951eea1bea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830674.272021:0:14460:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.121@tcp lock: ffff9e257d945400/0x575506951eea1bea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830674.272033:0:14460:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.121@tcp lock: ffff9e257d945400/0x575506951eea1bea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788830674.272059:0:14460:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2545cbc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3689682b-484d-410c-a8fd-1b98c0369c65:14460:1875724595190144:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788830674.272126:0:14460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830674.272826:0:14460:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e257fc23b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788830674.273902:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595190144 00000100:00100000:0.0:1788830674.273921:0:14455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595190144 00000100:00100000:1.0:1788830674.277014:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788830674.277030:0:14455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e24451c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3689682b-484d-410c-a8fd-1b98c0369c65+11:14460:x1875724595190144:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788830674.277047:0:14455:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788830674.277071:0:14455:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e257fa8d600/0x575506951eea1bf1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x575506951eea1bea expref: -99 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830674.277114:0:14455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e257fa8d600/0x575506951eea1bf1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x575506951eea1bea expref: 12 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830674.277125:0:14455:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e257fa8d600/0x575506951eea1bf1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x575506951eea1bea expref: 12 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830674.277134:0:14455:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e257fa8d600, rc 0) 00000100:00100000:1.0:1788830674.277214:0:14455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e24451c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3689682b-484d-410c-a8fd-1b98c0369c65+12:14460:x1875724595190144:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 188us (5087us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830674.277221:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788830674.277307:0:14460:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2545cbc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3689682b-484d-410c-a8fd-1b98c0369c65:14460:1875724595190144:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788830674.277327:0:14460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.121@tcp lock: ffff9e257d945400/0x575506951eea1bea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea1bf1 expref: -99 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830674.277338:0:14460:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.121@tcp lock: ffff9e257d945400/0x575506951eea1bea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x575506951eea1bf1 expref: -99 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788830674.277400:0:14460:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25478b7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3689682b-484d-410c-a8fd-1b98c0369c65:14460:1875724595190272:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788830674.277440:0:14460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830674.277649:0:14460:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2548010b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788830674.280950:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595190272 00000100:00100000:3.0:1788830674.280965:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595190272 00000100:00100000:3.0:1788830674.281027:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788830674.281037:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e24451ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3689682b-484d-410c-a8fd-1b98c0369c65+12:14460:x1875724595190272:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788830674.281064:0:14457:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788830674.281086:0:14457:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788830674.281089:0:14457:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:3.0:1788830674.281225:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e24451ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3689682b-484d-410c-a8fd-1b98c0369c65+12:14460:x1875724595190272:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 189us (3783us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830674.281233:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788830674.284361:0:14460:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25478b7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3689682b-484d-410c-a8fd-1b98c0369c65:14460:1875724595190272:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788830674.284432:0:14460:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.121@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788830674.284442:0:14460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: ffff9e257d945400/0x575506951eea1bea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea1bf1 expref: -99 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830674.284465:0:14460:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.121@tcp lock: ffff9e257d945400/0x575506951eea1bea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea1bf1 expref: -99 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830674.662961:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788830674.972337:0:14495:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788830674.972345:0:14495:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788830674.972374:0:14495:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:1.0:1788830674.972379:0:14495:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1788830675.675923:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788830676.639368:0:14742:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg121-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788830676.700020:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788830677.724528:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788830678.236844:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788830678.236852:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788830678.236855:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788830678.236857:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788830678.236860:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788830678.236863:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788830678.236867:0:36:0:(import.c:65:import_set_state_nolock()) ffff9e2544820800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788830678.236881:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9e2544820800 using connection 192.168.201.121@tcp/0@lo 00000100:00100000:1.0:1788830678.236920:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e25747c0000 x1875724595190528/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788830678.236959:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788830678.236971:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25747c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3689682b-484d-410c-a8fd-1b98c0369c65:3307:1875724595190400:0@lo:400:kworker.0 00000100:00100000:3.0:1788830678.236983:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25747c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875724595190528:0@lo:38:kworker.0 00000100:00100000:2.0:1788830678.246920:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788830678.247031:0:14465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595190528 00000100:00100000:2.0:1788830678.247040:0:14465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595190528 00000100:00100000:2.0:1788830678.247076:0:14465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788830678.247084:0:14465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25658c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3306:x1875724595190528:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1788830678.247113:0:14465:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 431 last 0 00000020:00000080:2.0:1788830678.247156:0:14465:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x575506951eea1bf8 00000004:00100000:2.0:1788830678.247219:0:14465:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788830678.247346:0:14465:0:(import.c:65:import_set_state_nolock()) ffff9e25707d2000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788830678.247385:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830678.247791:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595190400 00000100:00100000:0.0:1788830678.247797:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595190400 00000100:00100000:0.0:1788830678.247832:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788830678.247840:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e24451c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3689682b-484d-410c-a8fd-1b98c0369c65+12:3307:x1875724595190400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788830678.250847:0:14465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25658c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875724595190528:12345-0@lo:38:kworker.0 Request processed in 3754us (3928us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830678.250863:0:14465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788830678.251893:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9e25747c0000 x1875724595190528/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788830688 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788830678.251917:0:3306:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1788830678.251925:0:3306:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1788830678.251931:0:3306:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788830678.251935:0:3306:0:(import.c:65:import_set_state_nolock()) ffff9e2544820800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788830678.251942:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25747c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875724595190528:0@lo:38:kworker.0 00000100:00100000:0.0:1788830678.252191:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e24451c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3689682b-484d-410c-a8fd-1b98c0369c65+12:3307:x1875724595190400:12345-0@lo:400:kworker.0 Request processed in 4350us (4804us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830678.252202:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788830678.260005:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25747c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3689682b-484d-410c-a8fd-1b98c0369c65:3307:1875724595190400:0@lo:400:kworker.0 00010000:00010000:1.0:1788830678.747939:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788830679.321402:0:14893:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffffae616b0 20000000:00000080:2.0:1788830679.321419:0:14893:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9e25521ca400 uarg=0000000000000000 20000000:01000000:2.0:1788830679.321451:0:14893:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1788830679.321459:0:14893:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1788830679.321463:0:14893:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1788830679.324377:0:14894:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:2.0:1788830679.324537:0:14893:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:2.0:1788830679.330949:0:14893:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788830679.330980:0:14893:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2565729e00/0x575506951eea1bff lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830679.330999:0:14893:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2565729800/0x575506951eea1bc0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x575506951eea1bb9 expref: 11 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830679.331007:0:14893:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2565729e00/0x575506951eea1bff lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830679.331049:0:14893:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2565729800/0x575506951eea1bc0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x575506951eea1bb9 expref: 11 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830679.331066:0:14893:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e2565729800/0x575506951eea1bc0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x575506951eea1bb9 expref: 11 pid: 14457 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788830679.331081:0:14893:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25658c0380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14893:1875724595190656:0@lo:104: 00000100:00100000:2.0:1788830679.331149:0:14893:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788830679.331224:0:14893:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2548034c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788830679.332515:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595190656 00000100:00100000:3.0:1788830679.332524:0:14446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595190656 00000100:00100000:3.0:1788830679.332588:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788830679.332599:0:14446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25658c0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3689682b-484d-410c-a8fd-1b98c0369c65+3:14893:x1875724595190656:12345-0@lo:104: 00010000:00010000:3.0:1788830679.332617:0:14446:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.121@tcp lock: ffff9e257fa8c600/0x575506951eea1bb9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x575506951eea1bc0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830679.332739:0:14446:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788830679.332745:0:14446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25658c0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3689682b-484d-410c-a8fd-1b98c0369c65+3:14893:x1875724595190656:12345-0@lo:104: Request processed in 150us (1596us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830679.332753:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1788830679.333048:0:14451:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788830679.333055:0:14451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.121@tcp lock: ffff9e257fa8c600/0x575506951eea1bb9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x575506951eea1bc0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830679.333064:0:14451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e257fa8c600 already unused, calling callback (ffffffffc1aebc20) 10000000:00010000:0.0:1788830679.333068:0:14451:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.121@tcp lock: ffff9e257fa8c600/0x575506951eea1bb9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x575506951eea1bc0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830679.333076:0:14451:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.121@tcp lock: ffff9e257fa8c600/0x575506951eea1bb9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x575506951eea1bc0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788830679.333094:0:14451:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.121@tcp lock: ffff9e257fa8c600/0x575506951eea1bb9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x575506951eea1bc0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788830679.333096:0:14893:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25658c0380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14893:1875724595190656:0@lo:104: 10000000:01000000:0.0:1788830679.333116:0:14451:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788830679.333121:0:14893:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2565729e00/0x575506951eea1bff lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830679.333162:0:14451:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.121@tcp lock: ffff9e257fa8c600/0x575506951eea1bb9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x575506951eea1bc0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830679.333170:0:14451:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788830679.333197:0:14451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.121@tcp lock: ffff9e257fa8c600/0x575506951eea1bb9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x575506951eea1bc0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830679.333205:0:14451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.121@tcp lock: ffff9e257fa8c600/0x575506951eea1bb9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x575506951eea1bc0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830679.333220:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788830679.333222:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788830679.333224:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788830679.333230:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25478b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3689682b-484d-410c-a8fd-1b98c0369c65:3309:1875724595190784:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788830679.333340:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788830679.333446:0:14448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595190784 00000100:00100000:2.0:1788830679.333451:0:14448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595190784 00010000:00010000:2.0:1788830679.333470:0:14448:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2565729800/0x575506951eea1bc0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x575506951eea1bb9 expref: 12 pid: 14457 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788830679.333499:0:14448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788830679.333507:0:14448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25747c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3689682b-484d-410c-a8fd-1b98c0369c65+12:3309:x1875724595190784:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788830679.333517:0:14448:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788830679.333522:0:14448:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2565729800/0x575506951eea1bc0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x575506951eea1bb9 expref: 12 pid: 14457 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830679.333532:0:14448:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2565729800/0x575506951eea1bc0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x575506951eea1bb9 expref: 12 pid: 14457 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830679.333544:0:14448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2565729800/0x575506951eea1bc0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x575506951eea1bb9 expref: 12 pid: 14457 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830679.333568:0:14448:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2565729e00/0x575506951eea1bff lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830679.333577:0:14448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2565729e00/0x575506951eea1bff lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830679.333590:0:14448:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2565729e00/0x575506951eea1bff lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830679.333605:0:14448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2565729e00/0x575506951eea1bff lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830679.333612:0:14448:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2565729e00/0x575506951eea1bff lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830679.333618:0:14448:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2565729e00/0x575506951eea1bff lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830679.333624:0:14448:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2565729e00 already unused, calling callback (ffffffffc14cb350) 00010000:00010000:2.0:1788830679.333628:0:14448:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2565729e00/0x575506951eea1bff lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830679.333635:0:14448:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2565729e00/0x575506951eea1bff lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830679.333976:0:14893:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2565729e00/0x575506951eea1bff lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830679.333984:0:14893:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2565729e00/0x575506951eea1bff lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830679.334947:0:14448:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2565729e00/0x575506951eea1bff lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830679.334958:0:14448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2565729e00/0x575506951eea1bff lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830679.334974:0:14448:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788830679.335078:0:14448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25747c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3689682b-484d-410c-a8fd-1b98c0369c65+11:3309:x1875724595190784:12345-0@lo:103:ldlm_bl.0 Request processed in 1569us (1735us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830679.335087:0:14448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788830679.335147:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25478b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3689682b-484d-410c-a8fd-1b98c0369c65:3309:1875724595190784:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788830679.771900:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788830680.798936:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788830680.938965:0:14460:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788830680.938976:0:14460:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e25460f8000 from 10 10000000:01000000:0.0:1788830680.938983:0:14460:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788830680.939053:0:14460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.121@tcp lock: ffff9e25658d6600/0x575506951eea1c06 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830680.939068:0:14460:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.121@tcp lock: ffff9e25658d6600/0x575506951eea1c06 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830680.939082:0:14460:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.121@tcp lock: ffff9e25658d6600/0x575506951eea1c06 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788830680.939121:0:14460:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25478b6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3689682b-484d-410c-a8fd-1b98c0369c65:14460:1875724595190912:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788830680.939286:0:14460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830680.939365:0:14460:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2548010b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788830680.939430:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595190912 00000100:00100000:1.0:1788830680.939441:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595190912 00000100:00100000:1.0:1788830680.939519:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788830680.939531:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e24451cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3689682b-484d-410c-a8fd-1b98c0369c65+11:14460:x1875724595190912:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788830680.939548:0:14458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788830680.939567:0:14458:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e257fa8c000/0x575506951eea1c0d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x575506951eea1c06 expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830680.939600:0:14458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e257fa8c000/0x575506951eea1c0d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x575506951eea1c06 expref: 12 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830680.939612:0:14458:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e257fa8c000/0x575506951eea1c0d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x575506951eea1c06 expref: 12 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830680.939636:0:14458:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e257fa8c000, rc 0) 00000100:00100000:1.0:1788830680.939703:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e24451cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3689682b-484d-410c-a8fd-1b98c0369c65+12:14460:x1875724595190912:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 174us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830680.939900:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788830680.940045:0:14460:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25478b6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3689682b-484d-410c-a8fd-1b98c0369c65:14460:1875724595190912:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788830680.940065:0:14460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.121@tcp lock: ffff9e25658d6600/0x575506951eea1c06 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea1c0d expref: -99 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830680.940076:0:14460:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.121@tcp lock: ffff9e25658d6600/0x575506951eea1c06 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x575506951eea1c0d expref: -99 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788830680.940161:0:14460:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2545cbe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3689682b-484d-410c-a8fd-1b98c0369c65:14460:1875724595191040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788830680.940201:0:14460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830680.940226:0:14460:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2548064cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788830680.940304:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595191040 00000100:00100000:0.0:1788830680.940309:0:14455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595191040 00000100:00100000:0.0:1788830680.940355:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788830680.940363:0:14455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e24451cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3689682b-484d-410c-a8fd-1b98c0369c65+12:14460:x1875724595191040:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788830680.940988:0:14455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e24451cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3689682b-484d-410c-a8fd-1b98c0369c65+12:14460:x1875724595191040:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 618us (779us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830680.941005:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788830680.941045:0:14460:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2545cbe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3689682b-484d-410c-a8fd-1b98c0369c65:14460:1875724595191040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788830680.941093:0:14460:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2545cbe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3689682b-484d-410c-a8fd-1b98c0369c65:14460:1875724595191168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788830680.941152:0:14460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830680.941190:0:14460:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2548064cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788830680.941210:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595191168 00000100:00100000:1.0:1788830680.941221:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595191168 00000100:00100000:1.0:1788830680.941268:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788830680.941277:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25428e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3689682b-484d-410c-a8fd-1b98c0369c65+12:14460:x1875724595191168:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788830680.941731:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25428e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3689682b-484d-410c-a8fd-1b98c0369c65+12:14460:x1875724595191168:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 434us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830680.941740:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788830680.942192:0:14460:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2545cbe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3689682b-484d-410c-a8fd-1b98c0369c65:14460:1875724595191168:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788830680.943330:0:14960:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1788830680.943696:0:14460:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1788830680.943952:0:14460:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788830680.943969:0:14460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: ffff9e25658d6600/0x575506951eea1c06 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea1c0d expref: -99 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830680.943983:0:14460:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.121@tcp lock: ffff9e25658d6600/0x575506951eea1c06 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea1c0d expref: -99 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830681.819908:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788830682.332846:0:3306:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788830672/real 1788830672] req@ffff9e25478b4e00 x1875724595187840/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788830682 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788830682.332911:0:3306:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e25478b4e00 x1875724595187840/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788830682 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788830682.332922:0:3306:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788830672/real 1788830672] req@ffff9e25747c2680 x1875724595187712/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788830682 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788830682.332934:0:3306:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e25747c2680 x1875724595187712/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788830682 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788830682.332952:0:3306:0:(import.c:65:import_set_state_nolock()) ffff9e25430e7800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788830682.332973:0:3306:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788830682.332977:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25478b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1875724595187840:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1788830682.332982:0:3306:0:(import.c:65:import_set_state_nolock()) ffff9e2548331000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788830682.332988:0:3306:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788830682.332990:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25747c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1875724595187712:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1788830682.333305:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788830682.333309:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788830682.333312:0:38:0:(import.c:65:import_set_state_nolock()) ffff9e2548331000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788830682.333326:0:38:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 426 00000100:00080000:3.0:1788830682.333331:0:38:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788830682.333338:0:38:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9e2548331000 using connection 192.168.201.121@tcp/0@lo 00000100:00100000:3.0:1788830682.333362:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e2545cbfb80 x1875724595191424/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788830682.333390:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788830682.333393:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788830682.333395:0:38:0:(import.c:65:import_set_state_nolock()) ffff9e25430e7800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788830682.333398:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 426 00000100:00080000:3.0:1788830682.333401:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788830682.333404:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9e25430e7800 using connection 192.168.201.121@tcp/0@lo 00000100:00100000:3.0:1788830682.333419:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e2545cbc700 x1875724595191552/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788830682.333462:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2545cbf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875724595191680:0@lo:400:kworker.0 00000100:00100000:3.0:1788830682.333557:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788830682.333558:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788830682.333566:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2545cbe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3689682b-484d-410c-a8fd-1b98c0369c65:3309:1875724595191296:0@lo:400:kworker.0 00000100:00100000:2.0:1788830682.333600:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830682.333650:0:14464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595191680 00000100:00100000:3.0:1788830682.333658:0:14464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595191680 00000100:00100000:3.0:1788830682.333726:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788830682.333738:0:14464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2545cbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875724595191680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788830682.333801:0:14464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2545cbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875724595191680:12345-0@lo:400:kworker.0 Request processed in 65us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830682.333808:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788830682.333852:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9e2545cbf800 x1875724595191680/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788830698 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788830682.333872:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2545cbf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875724595191680:0@lo:400:kworker.0 00000100:00100000:0.0:1788830682.333997:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595191296 00000100:00100000:0.0:1788830682.334002:0:14455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595191296 00000100:00100000:0.0:1788830682.334057:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788830682.334065:0:14455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25428e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3689682b-484d-410c-a8fd-1b98c0369c65+12:3309:x1875724595191296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788830682.334111:0:14455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25428e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3689682b-484d-410c-a8fd-1b98c0369c65+12:3309:x1875724595191296:12345-0@lo:400:kworker.0 Request processed in 47us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830682.334119:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788830682.334148:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2545cbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1875724595191424:0@lo:8:kworker.0 00000400:00000100:0.0:1788830682.334172:0:3306:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875724595191424 offset 0 length 520: 4 00000100:00100000:0.0:1788830682.334190:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2545cbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1875724595191552:0@lo:8:kworker.0 00000400:00000100:0.0:1788830682.334211:0:3306:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875724595191552 offset 0 length 520: 4 00000100:00100000:2.0:1788830682.334513:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2545cbe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3689682b-484d-410c-a8fd-1b98c0369c65:3309:1875724595191296:0@lo:400:kworker.0 00010000:00010000:2.0:1788830682.844070:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788830683.867865:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788830684.187214:0:15142:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788830684.187218:0:15142:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:0.0:1788830684.187422:0:15142:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9e2544c7e000 00000020:01000004:0.0:1788830684.187440:0:15142:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1788830684.187452:0:15142:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1788830684.187465:0:15142:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9e2544830000) 00000020:00000080:0.0:1788830684.187494:0:15142:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00000040:00080000:3.0:1788830684.200275:0:14495:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788830684.200532:0:14495:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788830684.202235:0:14495:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:3.0:1788830684.202405:0:14495:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788830684.202445:0:14495:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 1 count 1 00100000:10000000:0.0:1788830684.210025:0:15142:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1788830684.210615:0:15142:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1788830684.211703:0:15142:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1788830684.212033:0:15142:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:0.0:1788830684.212263:0:15142:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:0.0:1788830684.212878:0:15142:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 482: rc = 0 00100000:10000000:0.0:1788830684.212980:0:15142:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 482: rc = 0 00100000:10000000:0.0:1788830684.213077:0:15142:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 482: rc = 0 00100000:10000000:0.0:1788830684.213784:0:15142:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 622: rc = 0 00100000:10000000:0.0:1788830684.214046:0:15142:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 622: rc = 0 00100000:10000000:0.0:1788830684.214815:0:15142:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 622: rc = 0 00100000:10000000:0.0:1788830684.215084:0:15142:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 622: rc = 0 00100000:10000000:0.0:1788830684.215407:0:15142:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 622: rc = 0 00100000:10000000:0.0:1788830684.215980:0:15142:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 622: rc = 0 00000020:00000080:0.0:1788830684.216690:0:15142:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1788830684.216702:0:15142:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788830684.216810:0:15142:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x575506951eea1c1b 00000020:01000004:0.0:1788830684.216819:0:15142:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:0.0:1788830684.216842:0:15142:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.121@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1788830684.216845:0:15142:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.121@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1788830684.216850:0:15142:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1788830684.216855:0:15142:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1788830684.216867:0:15142:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9e2544833370) 00000020:00000080:0.0:1788830684.216877:0:15142:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:0.0:1788830684.222608:0:15142:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788830684.222846:0:15142:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1788830684.222853:0:15142:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1788830684.225818:0:15142:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1788830684.225842:0:15142:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1788830684.226186:0:15142:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1788830684.226193:0:15142:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1788830684.228399:0:15142:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788830684.228578:0:15142:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1788830684.228589:0:15142:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1788830684.229402:0:15142:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1788830684.229410:0:15142:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1788830684.248215:0:15142:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788830684.248449:0:15142:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788830684.248455:0:15142:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1788830684.251868:0:15142:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788830684.251885:0:15142:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1788830684.253998:0:15142:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788830684.254012:0:15142:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1788830684.257864:0:15142:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788830684.258192:0:15142:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1788830684.258199:0:15142:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1788830684.258984:0:15142:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1788830684.258992:0:15142:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1788830684.294273:0:15142:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788830684.294508:0:15142:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1788830684.294522:0:15142:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1788830684.297751:0:15142:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1788830684.297766:0:15142:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1788830684.298641:0:15142:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1788830684.298736:0:15142:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:3.0:1788830684.298744:0:15142:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.121@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1788830684.326216:0:15142:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.121@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788830684.326259:0:15142:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.121@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1788830684.326264:0:15142:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788830684.326265:0:15142:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788830684.326267:0:15142:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788830684.326268:0:15142:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788830684.326270:0:15142:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788830684.326271:0:15142:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788830684.326273:0:15142:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788830684.326274:0:15142:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788830684.326275:0:15142:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788830684.326279:0:15142:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1788830684.326281:0:15142:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788830684.326282:0:15142:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788830684.326283:0:15142:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788830684.326284:0:15142:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788830684.326286:0:15142:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788830684.326287:0:15142:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788830684.326288:0:15142:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788830684.326289:0:15142:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788830684.326290:0:15142:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788830684.326314:0:15142:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788830684.326468:0:15142:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25658c0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3689682b-484d-410c-a8fd-1b98c0369c65:15142:1875724595191808:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788830684.326552:0:15142:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830684.326651:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595191808 00000100:00100000:0.0:1788830684.326661:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595191808 00000100:00100000:2.0:1788830684.326692:0:15142:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e25501a73c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788830684.326825:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788830684.326835:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25428e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3689682b-484d-410c-a8fd-1b98c0369c65+12:15142:x1875724595191808:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788830684.326874:0:14458:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788830684.326877:0:14458:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1788830684.326880:0:14458:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1788830684.386481:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25428e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3689682b-484d-410c-a8fd-1b98c0369c65+12:15142:x1875724595191808:12345-0@lo:253:mount.lustre.0 Request processed in 59631us (59911us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830684.386497:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788830684.386640:0:15142:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25658c0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3689682b-484d-410c-a8fd-1b98c0369c65:15142:1875724595191808:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788830684.386657:0:15142:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788830684.386660:0:15142:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788830684.386662:0:15142:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788830684.386664:0:15142:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788830684.386665:0:15142:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788830684.386666:0:15142:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788830684.386667:0:15142:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788830684.386669:0:15142:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788830684.386671:0:15142:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788830684.386672:0:15142:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788830684.386693:0:15142:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9e2544c7e000 from lustre-OST0000 10000000:01000000:2.0:1788830684.386892:0:15142:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1788830684.386896:0:15142:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788830684.386904:0:15142:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9e25448299b8 local copy 00010000:00010000:2.0:1788830684.386914:0:15142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.121@tcp lock: ffff9e257fa8d200/0x575506951eea1b11 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea1b18 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788830684.387135:0:15142:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25658c0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3689682b-484d-410c-a8fd-1b98c0369c65:15142:1875724595191936:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788830684.387175:0:15142:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788830684.387270:0:15142:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2545d63840 going to sleep for 11 seconds 00000100:00100000:0.0:1788830684.387315:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595191936 00000100:00100000:0.0:1788830684.387322:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595191936 00000100:00100000:0.0:1788830684.387400:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788830684.387410:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25428e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3689682b-484d-410c-a8fd-1b98c0369c65+12:15142:x1875724595191936:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788830684.387601:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25428e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3689682b-484d-410c-a8fd-1b98c0369c65+12:15142:x1875724595191936:12345-0@lo:501:mount.lustre.0 Request processed in 183us (417us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788830684.387609:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788830684.387683:0:15142:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25658c0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3689682b-484d-410c-a8fd-1b98c0369c65:15142:1875724595191936:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788830684.387697:0:15142:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.121@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788830684.387864:0:15142:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.121@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788830684.387872:0:15142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: ffff9e257fa8d200/0x575506951eea1b11 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea1b18 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830684.387881:0:15142:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.121@tcp lock: ffff9e257fa8d200/0x575506951eea1b11 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea1b18 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788830684.387909:0:15142:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9e2544c7e000 10000000:01000000:2.0:1788830684.387914:0:15142:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788830684.387919:0:15142:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9e25448299b8 10000000:01000000:2.0:1788830684.387922:0:15142:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1788830684.387925:0:15142:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e25448299b8 from 1 10000000:01000000:2.0:1788830684.387928:0:15142:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1788830684.387956:0:15142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.121@tcp lock: ffff9e2565728e00/0x575506951eea1c29 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830684.387965:0:15142:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.121@tcp lock: ffff9e2565728e00/0x575506951eea1c29 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830684.387974:0:15142:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.121@tcp lock: ffff9e2565728e00/0x575506951eea1c29 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788830684.387988:0:15142:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25658c0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3689682b-484d-410c-a8fd-1b98c0369c65:15142:1875724595192064:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788830684.388021:0:15142:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788830684.388237:0:15142:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2545d63840 going to sleep for 11 seconds 00000100:00100000:3.0:1788830684.388274:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595192064 00000100:00100000:3.0:1788830684.388279:0:14455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595192064 00000100:00100000:3.0:1788830684.388316:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788830684.388325:0:14455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25428e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3689682b-484d-410c-a8fd-1b98c0369c65+12:15142:x1875724595192064:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788830684.388334:0:14455:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788830684.388350:0:14455:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e257d945200/0x575506951eea1c30 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x575506951eea1c29 expref: -99 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830684.388372:0:14455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e257d945200/0x575506951eea1c30 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x575506951eea1c29 expref: 13 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830684.388381:0:14455:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e257d945200/0x575506951eea1c30 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x575506951eea1c29 expref: 13 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830684.388389:0:14455:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e257d945200, rc 0) 00000100:00100000:3.0:1788830684.388527:0:14455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25428e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3689682b-484d-410c-a8fd-1b98c0369c65+13:15142:x1875724595192064:12345-0@lo:101:mount.lustre.0 Request processed in 203us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830684.388534:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788830684.388598:0:15142:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25658c0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3689682b-484d-410c-a8fd-1b98c0369c65:15142:1875724595192064:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788830684.388612:0:15142:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.121@tcp lock: ffff9e2565728e00/0x575506951eea1c29 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea1c30 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830684.388620:0:15142:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.121@tcp lock: ffff9e2565728e00/0x575506951eea1c29 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x575506951eea1c30 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788830684.388637:0:15142:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1788830684.388653:0:15142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: ffff9e2565728e00/0x575506951eea1c29 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea1c30 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830684.388672:0:15142:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.121@tcp lock: ffff9e2565728e00/0x575506951eea1c29 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea1c30 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788830684.388678:0:15142:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788830684.388681:0:15142:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788830684.388685:0:15142:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1788830684.388687:0:15142:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788830684.388702:0:15142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.121@tcp lock: ffff9e2565728c00/0x575506951eea1c37 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830684.388774:0:15142:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.121@tcp lock: ffff9e2565728c00/0x575506951eea1c37 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830684.388783:0:15142:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.121@tcp lock: ffff9e2565728c00/0x575506951eea1c37 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788830684.388796:0:15142:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25658c0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3689682b-484d-410c-a8fd-1b98c0369c65:15142:1875724595192192:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788830684.388825:0:15142:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788830684.388887:0:15142:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2545d63840 going to sleep for 11 seconds 00000100:00100000:0.0:1788830684.388933:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595192192 00000100:00100000:0.0:1788830684.388937:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595192192 00000100:00100000:3.0:1788830684.388979:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788830684.388987:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25428e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3689682b-484d-410c-a8fd-1b98c0369c65+13:15142:x1875724595192192:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788830684.389003:0:14458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788830684.389012:0:14458:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e257d945a00/0x575506951eea1c3e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x575506951eea1c37 expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830684.389027:0:14458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e257d945a00/0x575506951eea1c3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x575506951eea1c37 expref: 14 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830684.389036:0:14458:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e257d945a00/0x575506951eea1c3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x575506951eea1c37 expref: 14 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830684.389043:0:14458:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e257d945a00, rc 0) 00000100:00100000:3.0:1788830684.389123:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25428e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3689682b-484d-410c-a8fd-1b98c0369c65+14:15142:x1875724595192192:12345-0@lo:101:mount.lustre.0 Request processed in 136us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830684.389129:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788830684.389244:0:15142:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25658c0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3689682b-484d-410c-a8fd-1b98c0369c65:15142:1875724595192192:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788830684.389254:0:15142:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.121@tcp lock: ffff9e2565728c00/0x575506951eea1c37 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea1c3e expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830684.389263:0:15142:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.121@tcp lock: ffff9e2565728c00/0x575506951eea1c37 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x575506951eea1c3e expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788830684.390143:0:15142:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1788830684.391145:0:15142:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788830684.391402:0:15142:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1788830684.391445:0:15142:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1788830684.391563:0:15142:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1788830684.391639:0:15142:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1788830684.391680:0:15142:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1788830684.391809:0:15142:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1788830684.391895:0:15142:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1788830684.391904:0:15142:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1788830684.391987:0:15142:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25658c0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3689682b-484d-410c-a8fd-1b98c0369c65:15142:1875724595192320:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788830684.392049:0:15142:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788830684.392138:0:15142:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2545d63840 going to sleep for 11 seconds 00000100:00100000:3.0:1788830684.392211:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595192320 00000100:00100000:3.0:1788830684.392219:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595192320 00000100:00100000:3.0:1788830684.392317:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788830684.392327:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25428e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3689682b-484d-410c-a8fd-1b98c0369c65+14:15142:x1875724595192320:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788830684.392692:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25428e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3689682b-484d-410c-a8fd-1b98c0369c65+14:15142:x1875724595192320:12345-0@lo:501:mount.lustre.0 Request processed in 365us (642us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830684.392701:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788830684.392831:0:15142:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25658c0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3689682b-484d-410c-a8fd-1b98c0369c65:15142:1875724595192320:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788830684.392865:0:15142:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25658c0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3689682b-484d-410c-a8fd-1b98c0369c65:15142:1875724595192448:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788830684.392905:0:15142:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788830684.393118:0:15142:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2545d63840 going to sleep for 11 seconds 00000100:00100000:0.0:1788830684.393155:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595192448 00000100:00100000:0.0:1788830684.393161:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595192448 00000100:00100000:0.0:1788830684.393188:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788830684.393196:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25428e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3689682b-484d-410c-a8fd-1b98c0369c65+14:15142:x1875724595192448:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788830684.393656:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25428e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3689682b-484d-410c-a8fd-1b98c0369c65+14:15142:x1875724595192448:12345-0@lo:503:mount.lustre.0 Request processed in 459us (749us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830684.393664:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788830684.393800:0:15142:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25658c0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3689682b-484d-410c-a8fd-1b98c0369c65:15142:1875724595192448:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788830684.394266:0:15142:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788830684.394323:0:15142:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25658c0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3689682b-484d-410c-a8fd-1b98c0369c65:15142:1875724595192576:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788830684.394367:0:15142:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788830684.394400:0:15142:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2545d63840 going to sleep for 11 seconds 00000100:00100000:3.0:1788830684.394458:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595192576 00000100:00100000:3.0:1788830684.394463:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595192576 00000100:00100000:3.0:1788830684.394620:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788830684.394630:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25428e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3689682b-484d-410c-a8fd-1b98c0369c65+14:15142:x1875724595192576:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788830684.394851:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25428e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3689682b-484d-410c-a8fd-1b98c0369c65+14:15142:x1875724595192576:12345-0@lo:502:mount.lustre.0 Request processed in 222us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830684.394869:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788830684.394954:0:15142:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25658c0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3689682b-484d-410c-a8fd-1b98c0369c65:15142:1875724595192576:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788830684.395172:0:15142:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1788830684.395213:0:15142:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1788830684.395244:0:15142:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1788830684.395304:0:15142:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1788830684.395341:0:15142:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1788830684.395370:0:15142:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1788830684.395432:0:15142:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1788830684.395560:0:15142:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1788830684.395612:0:15142:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:2.0:1788830684.395663:0:15142:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:2.0:1788830684.395697:0:15142:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:2.0:1788830684.395774:0:15142:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:2.0:1788830684.395808:0:15142:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25658c0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3689682b-484d-410c-a8fd-1b98c0369c65:15142:1875724595192704:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788830684.395855:0:15142:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788830684.396858:0:15142:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2545d63840 going to sleep for 11 seconds 00000100:00100000:0.0:1788830684.396910:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595192704 00000100:00100000:0.0:1788830684.396917:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595192704 00000100:00100000:0.0:1788830684.396952:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788830684.396959:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25428e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3689682b-484d-410c-a8fd-1b98c0369c65+14:15142:x1875724595192704:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788830684.397157:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25428e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3689682b-484d-410c-a8fd-1b98c0369c65+14:15142:x1875724595192704:12345-0@lo:502:mount.lustre.0 Request processed in 197us (1300us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830684.397165:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788830684.397261:0:15142:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25658c0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3689682b-484d-410c-a8fd-1b98c0369c65:15142:1875724595192704:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788830684.397351:0:15142:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:2.0:1788830684.397364:0:15142:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:3.0:1788830684.398222:0:15159:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788830684.398231:0:15159:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1788830684.398237:0:15159:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788830684.398239:0:15159:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1788830684.398245:0:15159:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788830684.398260:0:15159:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9e2547ae0000) 00000020:00000080:3.0:1788830684.398284:0:15159:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788830684.398290:0:15159:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788830684.398353:0:15159:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e2544c7e000 from lustre-OST0000, refs=2 00080000:01000000:3.0:1788830684.398361:0:15159:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788830684.398367:0:15159:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x575506951eea1c4c 00010000:00010000:2.0:1788830684.402162:0:15159:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:2.0:1788830684.402631:0:15159:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:2.0:1788830684.404984:0:15159:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:3.0:1788830684.408546:0:15159:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1788830684.408559:0:15159:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788830684.408566:0:15159:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788830684.408569:0:15159:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1788830684.408572:0:15159:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788830684.408575:0:15159:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #16 00000020:01000000:3.0:1788830684.408577:0:15159:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788830684.408579:0:15159:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788830684.408580:0:15159:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788830684.408583:0:15159:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788830684.408584:0:15159:0:(obd_config.c:1563:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788830684.408587:0:15159:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788830684.408601:0:15159:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788830684.408602:0:15159:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788830684.408606:0:15159:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788830684.408608:0:15159:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788830684.408611:0:15159:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788830684.408614:0:15159:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788830684.408615:0:15159:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788830684.408617:0:15159:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788830684.408620:0:15159:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788830684.408631:0:15159:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788830684.408637:0:15159:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1788830684.408736:0:15159:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788830684.408741:0:15159:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788830684.408743:0:15159:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788830684.408746:0:15159:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:2.0:1788830684.410606:0:15142:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:2.0:1788830684.410643:0:15142:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.121@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788830684.410663:0:15142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: ffff9e2565728c00/0x575506951eea1c37 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea1c3e expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830684.410676:0:15142:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.121@tcp lock: ffff9e2565728c00/0x575506951eea1c37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea1c3e expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788830684.410684:0:15142:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e2544c7e000 from 1 10000000:01000000:2.0:1788830684.410686:0:15142:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788830684.410751:0:15142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.121@tcp lock: ffff9e2565728800/0x575506951eea1c53 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830684.410760:0:15142:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.121@tcp lock: ffff9e2565728800/0x575506951eea1c53 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830684.410783:0:15142:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.121@tcp lock: ffff9e2565728800/0x575506951eea1c53 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788830684.410807:0:15142:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25658c0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3689682b-484d-410c-a8fd-1b98c0369c65:15142:1875724595192832:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788830684.410876:0:15142:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788830684.410923:0:15142:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2545d63600 going to sleep for 11 seconds 00000100:00100000:2.0:1788830684.412788:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595192832 00000100:00100000:2.0:1788830684.412801:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595192832 00000100:00100000:2.0:1788830684.412855:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788830684.412866:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25428e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3689682b-484d-410c-a8fd-1b98c0369c65+14:15142:x1875724595192832:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788830684.412894:0:14457:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788830684.412919:0:14457:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2565728400/0x575506951eea1c5a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x575506951eea1c53 expref: -99 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830684.412971:0:14457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2565728400/0x575506951eea1c5a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x575506951eea1c53 expref: 15 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830684.412983:0:14457:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2565728400/0x575506951eea1c5a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x575506951eea1c53 expref: 15 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830684.412994:0:14457:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2565728400, rc 0) 00000100:00100000:2.0:1788830684.413075:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25428e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3689682b-484d-410c-a8fd-1b98c0369c65+15:15142:x1875724595192832:12345-0@lo:101:mount.lustre.0 Request processed in 211us (2198us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830684.413097:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788830684.413156:0:15142:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25658c0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3689682b-484d-410c-a8fd-1b98c0369c65:15142:1875724595192832:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788830684.413171:0:15142:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.121@tcp lock: ffff9e2565728800/0x575506951eea1c53 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea1c5a expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830684.413188:0:15142:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.121@tcp lock: ffff9e2565728800/0x575506951eea1c53 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x575506951eea1c5a expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788830684.415855:0:15142:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1788830684.417796:0:15142:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788830684.419677:0:15142:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1788830684.419789:0:15142:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1788830684.419891:0:15142:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1788830684.419900:0:15142:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1788830684.419998:0:15142:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25658c0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3689682b-484d-410c-a8fd-1b98c0369c65:15142:1875724595192960:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788830684.420072:0:15142:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830684.420580:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595192960 00000100:00100000:0.0:1788830684.420599:0:14455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595192960 00000100:00100000:2.0:1788830684.420612:0:15142:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2545d63600 going to sleep for 11 seconds 00000100:00100000:0.0:1788830684.420654:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788830684.420675:0:14455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25428e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3689682b-484d-410c-a8fd-1b98c0369c65+15:15142:x1875724595192960:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788830684.420961:0:14455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25428e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3689682b-484d-410c-a8fd-1b98c0369c65+15:15142:x1875724595192960:12345-0@lo:501:mount.lustre.0 Request processed in 289us (889us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830684.420968:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788830684.421164:0:15142:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25658c0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3689682b-484d-410c-a8fd-1b98c0369c65:15142:1875724595192960:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788830684.421201:0:15142:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25658c0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3689682b-484d-410c-a8fd-1b98c0369c65:15142:1875724595193088:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788830684.421242:0:15142:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788830684.421276:0:15142:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2545d63600 going to sleep for 11 seconds 00000100:00100000:1.0:1788830684.422625:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595193088 00000100:00100000:1.0:1788830684.422636:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595193088 00000100:00100000:1.0:1788830684.422690:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788830684.422700:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257e966450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3689682b-484d-410c-a8fd-1b98c0369c65+15:15142:x1875724595193088:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788830684.423080:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257e966450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3689682b-484d-410c-a8fd-1b98c0369c65+15:15142:x1875724595193088:12345-0@lo:503:mount.lustre.0 Request processed in 380us (1835us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830684.423089:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788830684.423206:0:15142:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25658c0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3689682b-484d-410c-a8fd-1b98c0369c65:15142:1875724595193088:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788830684.423979:0:15142:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788830684.424067:0:15142:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25658c0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3689682b-484d-410c-a8fd-1b98c0369c65:15142:1875724595193216:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788830684.424123:0:15142:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788830684.424823:0:15142:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2545d63600 going to sleep for 11 seconds 00000100:00100000:0.0:1788830684.426259:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595193216 00000100:00100000:0.0:1788830684.426345:0:14455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595193216 00000100:00100000:0.0:1788830684.426464:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788830684.426476:0:14455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257e966c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3689682b-484d-410c-a8fd-1b98c0369c65+15:15142:x1875724595193216:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788830684.426957:0:14455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257e966c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3689682b-484d-410c-a8fd-1b98c0369c65+15:15142:x1875724595193216:12345-0@lo:502:mount.lustre.0 Request processed in 482us (2833us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830684.426965:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788830684.427016:0:15142:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25658c0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3689682b-484d-410c-a8fd-1b98c0369c65:15142:1875724595193216:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788830684.427334:0:15142:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1788830684.427387:0:15142:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1788830684.427438:0:15142:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1788830684.427502:0:15142:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1788830684.427537:0:15142:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1788830684.427586:0:15142:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1788830684.427636:0:15142:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1788830684.427673:0:15142:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:2.0:1788830684.427742:0:15142:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25658c0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3689682b-484d-410c-a8fd-1b98c0369c65:15142:1875724595193344:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788830684.427796:0:15142:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788830684.427834:0:15142:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2545d63600 going to sleep for 11 seconds 00000100:00100000:0.0:1788830684.428669:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595193344 00000100:00100000:0.0:1788830684.428679:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595193344 00000100:00100000:0.0:1788830684.428775:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788830684.428785:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257e965c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3689682b-484d-410c-a8fd-1b98c0369c65+15:15142:x1875724595193344:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788830684.429085:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257e965c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3689682b-484d-410c-a8fd-1b98c0369c65+15:15142:x1875724595193344:12345-0@lo:502:mount.lustre.0 Request processed in 300us (1288us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830684.429101:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788830684.429205:0:15142:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25658c0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3689682b-484d-410c-a8fd-1b98c0369c65:15142:1875724595193344:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788830684.429345:0:15142:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1788830684.429359:0:15142:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:3.0:1788830684.432176:0:15163:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788830684.432192:0:15163:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788830684.432194:0:15163:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788830684.432202:0:15163:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e2544c7e000 00000020:00000080:3.0:1788830684.432205:0:15163:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788830684.432213:0:15163:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788830684.432215:0:15163:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788830684.432217:0:15163:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788830684.432219:0:15163:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788830684.432222:0:15163:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788830684.432223:0:15163:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788830684.432226:0:15163:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e2544c7e000 00000020:00000080:3.0:1788830684.432228:0:15163:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788830684.432454:0:15163:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788830684.432458:0:15163:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788830684.432460:0:15163:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788830684.432462:0:15163:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788830684.432474:0:15163:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788830684.432475:0:15163:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788830684.432479:0:15163:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9e2544c7e000 00000020:00000080:3.0:1788830684.432481:0:15163:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788830684.436654:0:15163:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788830684.436669:0:15163:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788830684.436671:0:15163:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1788830684.436677:0:15163:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:0.0:1788830684.437807:0:15142:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1788830684.437838:0:15142:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788830684.437854:0:15142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: ffff9e2565728800/0x575506951eea1c53 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea1c5a expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830684.437867:0:15142:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.121@tcp lock: ffff9e2565728800/0x575506951eea1c53 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea1c5a expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788830684.437913:0:15142:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788830684.437916:0:15142:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9e2544c7e000 10000000:01000000:0.0:1788830684.437918:0:15142:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9e2544c7e000 10000000:01000000:0.0:1788830684.437922:0:15142:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788830684.437927:0:15142:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9e2544c7e000 from 1 10000000:01000000:0.0:1788830684.437930:0:15142:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788830684.437963:0:15142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.121@tcp lock: ffff9e25658d6e00/0x575506951eea1c61 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830684.437971:0:15142:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.121@tcp lock: ffff9e25658d6e00/0x575506951eea1c61 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830684.437982:0:15142:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.121@tcp lock: ffff9e25658d6e00/0x575506951eea1c61 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788830684.438006:0:15142:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25478b5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3689682b-484d-410c-a8fd-1b98c0369c65:15142:1875724595193472:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788830684.438075:0:15142:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830684.438115:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595193472 00000100:00100000:2.0:1788830684.438947:0:15142:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e25519d1f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788830684.439536:0:14455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595193472 00000100:00100000:0.0:1788830684.439611:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788830684.439627:0:14455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257e964050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3689682b-484d-410c-a8fd-1b98c0369c65+15:15142:x1875724595193472:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788830684.439642:0:14455:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788830684.439657:0:14455:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e25658d6c00/0x575506951eea1c68 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x575506951eea1c61 expref: -99 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830684.439683:0:14455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e25658d6c00/0x575506951eea1c68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x575506951eea1c61 expref: 16 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830684.439694:0:14455:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e25658d6c00/0x575506951eea1c68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x575506951eea1c61 expref: 16 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830684.439703:0:14455:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e25658d6c00, rc 0) 00000100:00100000:0.0:1788830684.439789:0:14455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257e964050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3689682b-484d-410c-a8fd-1b98c0369c65+16:15142:x1875724595193472:12345-0@lo:101:mount.lustre.0 Request processed in 163us (1712us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830684.439798:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788830684.439812:0:15142:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25478b5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3689682b-484d-410c-a8fd-1b98c0369c65:15142:1875724595193472:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788830684.439833:0:15142:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.121@tcp lock: ffff9e25658d6e00/0x575506951eea1c61 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea1c68 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830684.439844:0:15142:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.121@tcp lock: ffff9e25658d6e00/0x575506951eea1c61 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x575506951eea1c68 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788830684.440621:0:15142:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:2.0:1788830684.441077:0:15142:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788830684.441551:0:15142:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1788830684.441613:0:15142:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1788830684.441641:0:15142:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1788830684.441680:0:15142:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1788830684.442350:0:15142:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1788830684.442413:0:15142:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1788830684.442453:0:15142:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1788830684.442488:0:15142:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1788830684.442535:0:15142:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1788830684.442581:0:15142:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1788830684.442633:0:15142:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1788830684.442686:0:15142:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1788830684.443078:0:15142:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1788830684.443123:0:15142:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1788830684.443171:0:15142:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1788830684.443204:0:15142:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1788830684.443230:0:15142:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1788830684.443326:0:15142:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1788830684.443363:0:15142:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1788830684.443380:0:15142:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1788830684.443405:0:15142:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1788830684.443424:0:15142:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1788830684.443442:0:15142:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1788830684.443471:0:15142:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1788830684.443495:0:15142:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:2.0:1788830684.443511:0:15142:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:2.0:1788830684.443534:0:15142:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:2.0:1788830684.443551:0:15142:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:2.0:1788830684.443643:0:15142:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:2.0:1788830684.443651:0:15142:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:2.0:1788830684.443982:0:15142:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25658c0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3689682b-484d-410c-a8fd-1b98c0369c65:15142:1875724595193600:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788830684.444046:0:15142:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788830684.444136:0:15142:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2545d63600 going to sleep for 11 seconds 00000100:00100000:0.0:1788830684.444181:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595193600 00000100:00100000:0.0:1788830684.444188:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595193600 00000100:00100000:0.0:1788830684.445215:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788830684.445230:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257e967850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3689682b-484d-410c-a8fd-1b98c0369c65+16:15142:x1875724595193600:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788830684.445555:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257e967850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3689682b-484d-410c-a8fd-1b98c0369c65+16:15142:x1875724595193600:12345-0@lo:501:mount.lustre.0 Request processed in 328us (1507us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830684.445563:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788830684.445671:0:15142:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25658c0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3689682b-484d-410c-a8fd-1b98c0369c65:15142:1875724595193600:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788830684.445830:0:15142:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25658c0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3689682b-484d-410c-a8fd-1b98c0369c65:15142:1875724595193728:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788830684.445872:0:15142:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788830684.445946:0:15142:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2545d63600 going to sleep for 11 seconds 00000100:00100000:0.0:1788830684.445987:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595193728 00000100:00100000:0.0:1788830684.445993:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595193728 00000100:00100000:0.0:1788830684.446055:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788830684.446063:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257e964850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3689682b-484d-410c-a8fd-1b98c0369c65+16:15142:x1875724595193728:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788830684.446197:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257e964850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3689682b-484d-410c-a8fd-1b98c0369c65+16:15142:x1875724595193728:12345-0@lo:503:mount.lustre.0 Request processed in 134us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830684.446211:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788830684.446259:0:15142:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25658c0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3689682b-484d-410c-a8fd-1b98c0369c65:15142:1875724595193728:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788830684.447184:0:15142:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788830684.447253:0:15142:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25658c0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3689682b-484d-410c-a8fd-1b98c0369c65:15142:1875724595193856:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788830684.447373:0:15142:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788830684.447450:0:15142:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2545d63600 going to sleep for 11 seconds 00000100:00100000:0.0:1788830684.447489:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595193856 00000100:00100000:0.0:1788830684.447495:0:14455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595193856 00000100:00100000:0.0:1788830684.447531:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788830684.447542:0:14455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257e964450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3689682b-484d-410c-a8fd-1b98c0369c65+16:15142:x1875724595193856:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788830684.451124:0:14455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257e964450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3689682b-484d-410c-a8fd-1b98c0369c65+16:15142:x1875724595193856:12345-0@lo:502:mount.lustre.0 Request processed in 3575us (3741us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830684.451137:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788830684.451240:0:15142:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25658c0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3689682b-484d-410c-a8fd-1b98c0369c65:15142:1875724595193856:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788830684.451545:0:15142:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1788830684.451657:0:15142:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1788830684.451693:0:15142:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1788830684.451983:0:15142:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1788830684.452031:0:15142:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1788830684.452087:0:15142:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1788830684.452124:0:15142:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1788830684.452154:0:15142:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1788830684.452187:0:15142:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1788830684.452213:0:15142:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1788830684.452233:0:15142:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1788830684.454396:0:15142:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1788830684.454524:0:15142:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1788830684.454566:0:15142:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1788830684.454654:0:15142:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1788830684.454692:0:15142:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1788830684.454878:0:15142:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1788830684.454933:0:15142:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1788830684.454970:0:15142:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1788830684.455005:0:15142:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1788830684.455054:0:15142:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1788830684.455090:0:15142:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1788830684.455125:0:15142:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1788830684.455176:0:15142:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1788830684.455212:0:15142:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:2.0:1788830684.455257:0:15142:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:2.0:1788830684.455388:0:15142:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:2.0:1788830684.455423:0:15142:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:2.0:1788830684.455470:0:15142:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:2.0:1788830684.455516:0:15142:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:2.0:1788830684.455550:0:15142:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:2.0:1788830684.455582:0:15142:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:2.0:1788830684.455628:0:15142:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:2.0:1788830684.455674:0:15142:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:2.0:1788830684.455854:0:15142:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:2.0:1788830684.455930:0:15142:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:2.0:1788830684.455966:0:15142:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:2.0:1788830684.455995:0:15142:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:2.0:1788830684.456039:0:15142:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:2.0:1788830684.456071:0:15142:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:2.0:1788830684.456121:0:15142:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25658c0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3689682b-484d-410c-a8fd-1b98c0369c65:15142:1875724595193984:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788830684.456200:0:15142:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788830684.456356:0:15142:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2545d63600 going to sleep for 11 seconds 00000100:00100000:3.0:1788830684.456430:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595193984 00000100:00100000:3.0:1788830684.456438:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595193984 00000100:00100000:3.0:1788830684.456516:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788830684.456533:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257e967450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3689682b-484d-410c-a8fd-1b98c0369c65+16:15142:x1875724595193984:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788830684.456847:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257e967450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3689682b-484d-410c-a8fd-1b98c0369c65+16:15142:x1875724595193984:12345-0@lo:502:mount.lustre.0 Request processed in 315us (645us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830684.456855:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788830684.457054:0:15142:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25658c0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3689682b-484d-410c-a8fd-1b98c0369c65:15142:1875724595193984:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788830684.457134:0:15142:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:2.0:1788830684.457145:0:15142:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:2.0:1788830684.462100:0:15168:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1788830684.462117:0:15168:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9e254482cd28) 00000020:00000080:2.0:1788830684.462139:0:15168:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:2.0:1788830684.462233:0:15168:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e2544c7e000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788830684.462237:0:15168:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e2544c7e000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788830684.462240:0:15168:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e2544c7e000 3 00010000:00080000:2.0:1788830684.462271:0:15168:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e2446c86800@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.121@tcp at head 00010000:00010000:2.0:1788830684.464371:0:15168:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:2.0:1788830684.464646:0:15168:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1788830684.464690:0:15168:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788830684.464705:0:15168:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x575506951eea1c76 00000100:00080000:2.0:1788830684.464770:0:15168:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788830684.464777:0:15168:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9e2446c86800 using connection 192.168.201.121@tcp/0@lo 00000100:00100000:2.0:1788830684.464835:0:15168:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e25658c0380 x1875724595194112/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788830684.464865:0:15168:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788830684.464887:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788830684.464891:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788830684.464894:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788830684.464897:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788830684.464945:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25658c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875724595194240:0@lo:400:kworker.0 00000100:00100000:2.0:1788830684.465009:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788830684.465066:0:14463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595194240 00000100:00100000:2.0:1788830684.465073:0:14463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595194240 00000100:00100000:2.0:1788830684.465113:0:14463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788830684.465122:0:14463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25658c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875724595194240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788830684.465173:0:14463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25658c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875724595194240:12345-0@lo:400:kworker.0 Request processed in 52us (164us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830684.465180:0:14463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788830684.465217:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9e25658c1f80 x1875724595194240/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788830700 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788830684.465231:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25658c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875724595194240:0@lo:400:kworker.0 00000100:00100000:3.0:1788830684.465516:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25658c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3306:1875724595194112:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788830684.465550:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788830684.465655:0:14464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595194112 00000100:00100000:2.0:1788830684.465665:0:14464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595194112 00000100:00100000:2.0:1788830684.465738:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788830684.465744:0:14464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2545cbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3306:x1875724595194112:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788830684.465775:0:14464:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 437 last 0 00000020:00000080:2.0:1788830684.465820:0:14464:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x575506951eea1c7d 00000004:00100000:2.0:1788830684.465837:0:14464:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788830684.465867:0:14464:0:(import.c:65:import_set_state_nolock()) ffff9e2446c82800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788830684.465912:0:14464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2545cbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875724595194112:12345-0@lo:38:llog_process_th.0 Request processed in 166us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830684.465919:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788830684.466945:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9e25658c0380 x1875724595194112/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788830694 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788830684.466956:0:3306:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788830684.466964:0:3306:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:3.0:1788830684.466972:0:3306:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788830684.466977:0:3306:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788830684.466981:0:3306:0:(import.c:65:import_set_state_nolock()) ffff9e2446c86800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788830684.466989:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25658c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3306:1875724595194112:0@lo:38:llog_process_th.0 00000040:00080000:3.0:1788830684.467484:0:15168:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:0.0:1788830684.469489:0:15142:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1788830684.469519:0:15142:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.121@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788830684.469535:0:15142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: ffff9e25658d6e00/0x575506951eea1c61 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea1c68 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830684.469547:0:15142:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.121@tcp lock: ffff9e25658d6e00/0x575506951eea1c61 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea1c68 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788830684.469608:0:15142:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788830684.469610:0:15142:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788830684.469612:0:15142:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788830684.469613:0:15142:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788830684.469614:0:15142:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788830684.469615:0:15142:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788830684.469617:0:15142:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788830684.469619:0:15142:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788830684.469620:0:15142:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788830684.469624:0:15142:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:0.0:1788830684.469626:0:15142:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788830684.469628:0:15142:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788830684.469629:0:15142:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788830684.469630:0:15142:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788830684.469631:0:15142:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788830684.469637:0:15142:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788830684.469638:0:15142:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788830684.469639:0:15142:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788830684.469640:0:15142:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788830684.469663:0:15142:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788830684.469682:0:15142:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25478b7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3689682b-484d-410c-a8fd-1b98c0369c65:15142:1875724595194368:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788830684.470399:0:15142:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830684.470433:0:15142:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2545d2c000 going to sleep for 11 seconds 00000100:00100000:2.0:1788830684.470478:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595194368 00000100:00100000:2.0:1788830684.470485:0:14455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595194368 00000100:00100000:2.0:1788830684.470534:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788830684.470545:0:14455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257e966850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3689682b-484d-410c-a8fd-1b98c0369c65+16:15142:x1875724595194368:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788830684.470571:0:14455:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788830684.470584:0:14455:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788830684.501970:0:14455:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788830684.501995:0:14455:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1788830684.502088:0:14479:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788830684.502093:0:14479:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788830684.502115:0:14479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e257d945800/0x575506951eea1c84 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830684.502133:0:14479:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e257fa8d600/0x575506951eea1bf1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x575506951eea1bea expref: 16 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830684.502142:0:14479:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e257d945800/0x575506951eea1c84 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830684.502184:0:14479:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e257fa8d600/0x575506951eea1bf1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x575506951eea1bea expref: 16 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830684.502212:0:14479:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e257fa8d600/0x575506951eea1bf1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x575506951eea1bea expref: 16 pid: 14455 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788830684.502228:0:14479:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2545cbce00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14479:1875724595194496:0@lo:104: 00000100:00100000:3.0:1788830684.502293:0:14479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830684.502337:0:14479:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2544a1cc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788830684.502392:0:14447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595194496 00000100:00100000:0.0:1788830684.502399:0:14447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595194496 00000100:00100000:0.0:1788830684.502446:0:14447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788830684.502455:0:14447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2545cbf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3689682b-484d-410c-a8fd-1b98c0369c65+3:14479:x1875724595194496:12345-0@lo:104: 00010000:00010000:0.0:1788830684.502477:0:14447:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.121@tcp lock: ffff9e257d945400/0x575506951eea1bea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x575506951eea1bf1 expref: -99 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830684.502522:0:14447:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788830684.502528:0:14447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2545cbf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3689682b-484d-410c-a8fd-1b98c0369c65+3:14479:x1875724595194496:12345-0@lo:104: Request processed in 74us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830684.502535:0:14447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1788830684.502538:0:14451:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788830684.502545:0:14451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.121@tcp lock: ffff9e257d945400/0x575506951eea1bea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x575506951eea1bf1 expref: -99 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830684.502553:0:14451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e257d945400 already unused, calling callback (ffffffffc1aebc20) 10000000:00010000:2.0:1788830684.502557:0:14451:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.121@tcp lock: ffff9e257d945400/0x575506951eea1bea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x575506951eea1bf1 expref: -99 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830684.502566:0:14451:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.121@tcp lock: ffff9e257d945400/0x575506951eea1bea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x575506951eea1bf1 expref: -99 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788830684.502574:0:14451:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.121@tcp lock: ffff9e257d945400/0x575506951eea1bea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x575506951eea1bf1 expref: -99 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788830684.502597:0:14451:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788830684.502634:0:14451:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.121@tcp lock: ffff9e257d945400/0x575506951eea1bea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x575506951eea1bf1 expref: -99 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830684.502640:0:14451:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788830684.502670:0:14451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.121@tcp lock: ffff9e257d945400/0x575506951eea1bea lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x575506951eea1bf1 expref: -99 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830684.502679:0:14451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.121@tcp lock: ffff9e257d945400/0x575506951eea1bea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x575506951eea1bf1 expref: -99 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830684.502695:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788830684.502697:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788830684.502699:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788830684.502752:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25658c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3689682b-484d-410c-a8fd-1b98c0369c65:3309:1875724595194624:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788830684.502783:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788830684.502828:0:14450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595194624 00000100:00100000:2.0:1788830684.502833:0:14450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595194624 00010000:00010000:2.0:1788830684.502850:0:14450:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e257fa8d600/0x575506951eea1bf1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x575506951eea1bea expref: 17 pid: 14455 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788830684.502887:0:14450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788830684.502894:0:14450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25658c1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3689682b-484d-410c-a8fd-1b98c0369c65+17:3309:x1875724595194624:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788830684.502903:0:14450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788830684.502909:0:14450:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e257fa8d600/0x575506951eea1bf1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x575506951eea1bea expref: 17 pid: 14455 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830684.502919:0:14450:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e257fa8d600/0x575506951eea1bf1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x575506951eea1bea expref: 17 pid: 14455 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830684.502941:0:14450:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e257d945800/0x575506951eea1c84 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830684.502950:0:14450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e257d945800/0x575506951eea1c84 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788830684.502963:0:14450:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004882318s 00010000:00010000:2.0:1788830684.503303:0:14450:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e257d945800/0x575506951eea1c84 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830684.503314:0:14450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e257d945800/0x575506951eea1c84 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830684.503321:0:14450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e257d945800/0x575506951eea1c84 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830684.503328:0:14450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e257d945800/0x575506951eea1c84 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830684.503333:0:14450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e257d945800 already unused, calling callback (ffffffffc14cb350) 00010000:00010000:2.0:1788830684.503337:0:14450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e257d945800/0x575506951eea1c84 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830684.503344:0:14450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e257d945800/0x575506951eea1c84 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830684.503353:0:14450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e257d945800/0x575506951eea1c84 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830684.503362:0:14450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788830684.503413:0:14450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25658c1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3689682b-484d-410c-a8fd-1b98c0369c65+17:3309:x1875724595194624:12345-0@lo:103:ldlm_bl.0 Request processed in 519us (628us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830684.503426:0:14450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1788830684.503464:0:14479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e257fa8d600/0x575506951eea1bf1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x575506951eea1bea expref: 16 pid: 14455 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788830684.503475:0:14479:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2545cbce00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14479:1875724595194496:0@lo:104: 00010000:00010000:2.0:1788830684.503496:0:14479:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e257d945800/0x575506951eea1c84 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830684.503505:0:14479:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e257d945800/0x575506951eea1c84 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830684.503511:0:14479:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e257d945800/0x575506951eea1c84 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830684.503517:0:14479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e257d945800/0x575506951eea1c84 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788830684.503735:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25658c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3689682b-484d-410c-a8fd-1b98c0369c65:3309:1875724595194624:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788830684.507295:0:14455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257e966850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3689682b-484d-410c-a8fd-1b98c0369c65+15:15142:x1875724595194368:12345-0@lo:253:mount.lustre.0 Request processed in 36745us (36889us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830684.507306:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788830684.507370:0:15142:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25478b7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3689682b-484d-410c-a8fd-1b98c0369c65:15142:1875724595194368:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788830684.507381:0:15142:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788830684.507383:0:15142:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788830684.507385:0:15142:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788830684.507385:0:15142:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788830684.507386:0:15142:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788830684.507387:0:15142:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788830684.507388:0:15142:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788830684.507389:0:15142:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788830684.507390:0:15142:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788830684.507391:0:15142:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788830684.507404:0:15142:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788830684.510453:0:15142:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1788830684.510635:0:15142:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788830684.510807:0:15142:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1788830684.510954:0:15142:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1788830684.511098:0:15142:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1788830684.511266:0:15142:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1788830684.512321:0:15142:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:1.0:1788830684.552041:0:15142:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1788830684.552050:0:15142:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1788830684.552086:0:15142:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788830684.552140:0:15142:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.121@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788830684.552156:0:15142:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1788830684.552184:0:15142:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:1.0:1788830684.892225:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788830685.916827:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788830686.493851:0:14460:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788830686.493859:0:14460:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9e25460f8000 from 7 10000000:01000000:0.0:1788830686.493864:0:14460:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788830686.493915:0:14460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.121@tcp lock: ffff9e25658d6a00/0x575506951eea1c8b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830686.493946:0:14460:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.121@tcp lock: ffff9e25658d6a00/0x575506951eea1c8b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830686.493959:0:14460:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.121@tcp lock: ffff9e25658d6a00/0x575506951eea1c8b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788830686.493988:0:14460:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25478b6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3689682b-484d-410c-a8fd-1b98c0369c65:14460:1875724595194752:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788830686.494067:0:14460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830686.494135:0:14460:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2545d2c6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788830686.494267:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595194752 00000100:00100000:3.0:1788830686.494275:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595194752 00000100:00100000:3.0:1788830686.494337:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788830686.494356:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257e967c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3689682b-484d-410c-a8fd-1b98c0369c65+15:14460:x1875724595194752:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788830686.494370:0:14457:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788830686.494394:0:14457:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e257d944a00/0x575506951eea1c92 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x575506951eea1c8b expref: -99 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830686.494419:0:14457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e257d944a00/0x575506951eea1c92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x575506951eea1c8b expref: 16 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830686.494430:0:14457:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e257d944a00/0x575506951eea1c92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x575506951eea1c8b expref: 16 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830686.494447:0:14457:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e257d944a00, rc 0) 00000100:00100000:3.0:1788830686.494497:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257e967c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3689682b-484d-410c-a8fd-1b98c0369c65+16:14460:x1875724595194752:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 152us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830686.494504:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788830686.494741:0:14460:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25478b6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3689682b-484d-410c-a8fd-1b98c0369c65:14460:1875724595194752:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788830686.494755:0:14460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.121@tcp lock: ffff9e25658d6a00/0x575506951eea1c8b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea1c92 expref: -99 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830686.494765:0:14460:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.121@tcp lock: ffff9e25658d6a00/0x575506951eea1c8b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x575506951eea1c92 expref: -99 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788830686.494818:0:14460:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25478b6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3689682b-484d-410c-a8fd-1b98c0369c65:14460:1875724595194880:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788830686.494848:0:14460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830686.494869:0:14460:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2545d2c6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788830686.494926:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595194880 00000100:00100000:1.0:1788830686.494931:0:14455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595194880 00000100:00100000:1.0:1788830686.494967:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788830686.494976:0:14455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257e965850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3689682b-484d-410c-a8fd-1b98c0369c65+16:14460:x1875724595194880:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788830686.494992:0:14455:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788830686.495012:0:14455:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788830686.495015:0:14455:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:1.0:1788830686.495171:0:14455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257e965850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3689682b-484d-410c-a8fd-1b98c0369c65+16:14460:x1875724595194880:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 196us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830686.495179:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788830686.495249:0:14460:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25478b6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3689682b-484d-410c-a8fd-1b98c0369c65:14460:1875724595194880:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788830686.495300:0:14460:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.121@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788830686.495307:0:14460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: ffff9e25658d6a00/0x575506951eea1c8b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea1c92 expref: -99 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830686.495315:0:14460:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.121@tcp lock: ffff9e25658d6a00/0x575506951eea1c8b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea1c92 expref: -99 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830686.940326:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788830687.963898:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788830688.987825:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788830689.509570:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788830689.509577:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788830689.509581:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788830689.509584:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788830689.509627:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25747c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875724595195136:0@lo:400:kworker.0 00000100:00100000:1.0:1788830689.509725:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830689.509915:0:14465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595195136 00000100:00100000:1.0:1788830689.509923:0:14465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595195136 00000100:00100000:1.0:1788830689.509969:0:14465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788830689.509984:0:14465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25747c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875724595195136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788830689.510038:0:14465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25747c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875724595195136:12345-0@lo:400:kworker.0 Request processed in 55us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830689.510045:0:14465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788830689.510086:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e25747c0a80 x1875724595195136/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788830705 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788830689.510100:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25747c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875724595195136:0@lo:400:kworker.0 00000100:00100000:1.0:1788830689.510137:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25747c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1875724595195264:0@lo:400:kworker.0 00000100:00100000:1.0:1788830689.510163:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830689.510191:0:14464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595195264 00000100:00100000:1.0:1788830689.510195:0:14464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595195264 00000100:00100000:1.0:1788830689.510235:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788830689.510241:0:14464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25747c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875724595195264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788830689.510274:0:14464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25747c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875724595195264:12345-0@lo:400:kworker.0 Request processed in 32us (109us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830689.510280:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788830689.510303:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e25747c0a80 x1875724595195264/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788830705 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788830689.510311:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25747c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1875724595195264:0@lo:400:kworker.0 00000100:00100000:3.0:1788830689.510482:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25747c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3689682b-484d-410c-a8fd-1b98c0369c65:3310:1875724595195008:0@lo:400:kworker.0 00000100:00100000:3.0:1788830689.510549:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830689.510801:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595195008 00000100:00100000:1.0:1788830689.510806:0:14455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595195008 00000100:00100000:1.0:1788830689.510840:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788830689.510847:0:14455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257e967050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3689682b-484d-410c-a8fd-1b98c0369c65+16:3310:x1875724595195008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788830689.510884:0:14455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257e967050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3689682b-484d-410c-a8fd-1b98c0369c65+16:3310:x1875724595195008:12345-0@lo:400:kworker.0 Request processed in 37us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830689.510900:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788830689.510932:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25747c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3689682b-484d-410c-a8fd-1b98c0369c65:3310:1875724595195008:0@lo:400:kworker.0 00000100:00080000:2.0:1788830689.511045:0:14459:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:0.0:1788830689.975634:0:15510:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg121-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788830690.014950:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788830691.036073:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788830692.060147:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788830693.086682:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788830694.114191:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788830694.438000:0:14495:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00080000:1.0:1788830694.621597:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788830694.621607:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788830694.621610:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788830694.621613:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788830694.621723:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25747c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1875724595195648:0@lo:400:kworker.0 00000100:00100000:1.0:1788830694.621826:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830694.621930:0:14463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595195648 00000100:00100000:1.0:1788830694.621940:0:14463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595195648 00000100:00100000:1.0:1788830694.622023:0:14463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788830694.622035:0:14463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25747c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875724595195648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788830694.622099:0:14463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25747c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875724595195648:12345-0@lo:400:kworker.0 Request processed in 65us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830694.622107:0:14463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1788830694.622133:0:14459:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788830694.622172:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e25747c2680 x1875724595195648/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788830710 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788830694.622189:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25747c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1875724595195648:0@lo:400:kworker.0 00000100:00100000:3.0:1788830694.622295:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25747c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875724595195520:0@lo:400:kworker.0 00000100:00100000:3.0:1788830694.622332:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830694.622368:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788830694.622374:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25747c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3689682b-484d-410c-a8fd-1b98c0369c65:3310:1875724595195392:0@lo:400:kworker.0 00000100:00100000:3.0:1788830694.622408:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830694.622458:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595195392 00000100:00100000:3.0:1788830694.622462:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595195392 00000100:00100000:3.0:1788830694.622510:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788830694.622518:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257e964c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3689682b-484d-410c-a8fd-1b98c0369c65+16:3310:x1875724595195392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788830694.622555:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257e964c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3689682b-484d-410c-a8fd-1b98c0369c65+16:3310:x1875724595195392:12345-0@lo:400:kworker.0 Request processed in 38us (146us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830694.622562:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788830694.622602:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25747c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3689682b-484d-410c-a8fd-1b98c0369c65:3310:1875724595195392:0@lo:400:kworker.0 00000100:00100000:1.0:1788830694.622997:0:14465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595195520 00000100:00100000:1.0:1788830694.623002:0:14465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595195520 00000100:00100000:1.0:1788830694.623043:0:14465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788830694.623065:0:14465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2545cbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875724595195520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788830694.623121:0:14465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2545cbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875724595195520:12345-0@lo:400:kworker.0 Request processed in 58us (789us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830694.623129:0:14465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1788830694.623195:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e25747c0a80 x1875724595195520/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788830710 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788830694.623206:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25747c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875724595195520:0@lo:400:kworker.0 00010000:00010000:1.0:1788830695.132304:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788830696.156899:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788830696.526020:0:15860:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788830696.526024:0:15860:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:0.0:1788830696.526170:0:15860:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9e2545177800 00000020:01000004:0.0:1788830696.526189:0:15860:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1788830696.526202:0:15860:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:0.0:1788830696.526216:0:15860:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9e2544834d28) 00000020:00000080:0.0:1788830696.526243:0:15860:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1788830696.548502:0:15860:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1788830696.548911:0:15860:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:1.0:1788830696.550939:0:15860:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1788830696.551374:0:15860:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:1.0:1788830696.551630:0:15860:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:1.0:1788830696.552341:0:15860:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 527: rc = 0 00100000:10000000:1.0:1788830696.552456:0:15860:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 527: rc = 0 00100000:10000000:1.0:1788830696.552551:0:15860:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 527: rc = 0 00100000:10000000:1.0:1788830696.553349:0:15860:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 452: rc = 0 00100000:10000000:1.0:1788830696.553628:0:15860:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 452: rc = 0 00100000:10000000:1.0:1788830696.554039:0:15860:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 452: rc = 0 00100000:10000000:1.0:1788830696.554503:0:15860:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 452: rc = 0 00100000:10000000:1.0:1788830696.554801:0:15860:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 452: rc = 0 00100000:10000000:1.0:1788830696.555037:0:15860:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 452: rc = 0 00000020:00000080:1.0:1788830696.555660:0:15860:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1788830696.555672:0:15860:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788830696.555683:0:15860:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x575506951eea1ca0 00000020:01000004:1.0:1788830696.555691:0:15860:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:1.0:1788830696.555757:0:15860:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.121@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1788830696.555761:0:15860:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.121@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1788830696.555768:0:15860:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1788830696.555791:0:15860:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:1.0:1788830696.555800:0:15860:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.121@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1788830696.566453:0:15860:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.121@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788830696.566499:0:15860:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.121@tcp, index=0001, flags=0x20002 00000020:01000004:1.0:1788830696.566504:0:15860:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788830696.566505:0:15860:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788830696.566507:0:15860:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788830696.566508:0:15860:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788830696.566509:0:15860:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788830696.566511:0:15860:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788830696.566512:0:15860:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788830696.566514:0:15860:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788830696.566515:0:15860:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788830696.566519:0:15860:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:1.0:1788830696.566521:0:15860:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788830696.566523:0:15860:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788830696.566524:0:15860:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788830696.566525:0:15860:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788830696.566526:0:15860:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788830696.566527:0:15860:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788830696.566528:0:15860:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788830696.566530:0:15860:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788830696.566531:0:15860:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788830696.566557:0:15860:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1788830696.566579:0:15860:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25747c2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3689682b-484d-410c-a8fd-1b98c0369c65:15860:1875724595195776:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788830696.566652:0:15860:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830696.566814:0:15860:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e254747ff00 going to sleep for 11 seconds 00000100:00100000:3.0:1788830696.566899:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595195776 00000100:00100000:3.0:1788830696.566907:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595195776 00000100:00100000:3.0:1788830696.567012:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788830696.567023:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257e966050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3689682b-484d-410c-a8fd-1b98c0369c65+16:15860:x1875724595195776:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788830696.567054:0:14457:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1788830696.567057:0:14457:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:3.0:1788830696.567061:0:14457:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1788830696.573815:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257e966050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3689682b-484d-410c-a8fd-1b98c0369c65+16:15860:x1875724595195776:12345-0@lo:253:mount.lustre.0 Request processed in 6784us (7153us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830696.573830:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788830696.573919:0:15860:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25747c2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3689682b-484d-410c-a8fd-1b98c0369c65:15860:1875724595195776:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788830696.573936:0:15860:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1788830696.573939:0:15860:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788830696.573941:0:15860:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788830696.573943:0:15860:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788830696.573944:0:15860:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788830696.573946:0:15860:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788830696.573947:0:15860:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788830696.573949:0:15860:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788830696.573951:0:15860:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788830696.573967:0:15860:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788830696.573986:0:15860:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9e2545177800 from lustre-OST0001 10000000:01000000:1.0:1788830696.574012:0:15860:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1788830696.574015:0:15860:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1788830696.574023:0:15860:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9e25448299b8 local copy 00010000:00010000:1.0:1788830696.574033:0:15860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.121@tcp lock: ffff9e257fa8d200/0x575506951eea1b11 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea1b18 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788830696.574551:0:15860:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25747c2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3689682b-484d-410c-a8fd-1b98c0369c65:15860:1875724595195904:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788830696.574595:0:15860:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830696.574675:0:15860:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e254747f840 going to sleep for 11 seconds 00000100:00100000:3.0:1788830696.574797:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595195904 00000100:00100000:3.0:1788830696.574804:0:14455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595195904 00000100:00100000:3.0:1788830696.575206:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788830696.575217:0:14455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257e965450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3689682b-484d-410c-a8fd-1b98c0369c65+16:15860:x1875724595195904:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788830696.575422:0:14455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257e965450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3689682b-484d-410c-a8fd-1b98c0369c65+16:15860:x1875724595195904:12345-0@lo:501:mount.lustre.0 Request processed in 207us (827us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788830696.575431:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788830696.575505:0:15860:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25747c2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3689682b-484d-410c-a8fd-1b98c0369c65:15860:1875724595195904:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788830696.575523:0:15860:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.121@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788830696.575681:0:15860:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.121@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788830696.575690:0:15860:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: ffff9e257fa8d200/0x575506951eea1b11 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea1b18 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830696.575700:0:15860:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.121@tcp lock: ffff9e257fa8d200/0x575506951eea1b11 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea1b18 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788830696.575748:0:15860:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9e2545177800 10000000:01000000:1.0:1788830696.575754:0:15860:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788830696.575760:0:15860:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1788830696.575762:0:15860:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788830696.575766:0:15860:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1788830696.575769:0:15860:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1788830696.575795:0:15860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.121@tcp lock: ffff9e257fa8cc00/0x575506951eea1ca7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830696.575803:0:15860:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.121@tcp lock: ffff9e257fa8cc00/0x575506951eea1ca7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830696.575822:0:15860:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.121@tcp lock: ffff9e257fa8cc00/0x575506951eea1ca7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788830696.575837:0:15860:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25747c2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3689682b-484d-410c-a8fd-1b98c0369c65:15860:1875724595196032:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788830696.575867:0:15860:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830696.576345:0:15860:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e254747f840 going to sleep for 11 seconds 00000100:00100000:2.0:1788830696.576448:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595196032 00000100:00100000:2.0:1788830696.576462:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595196032 00000100:00100000:2.0:1788830696.576494:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788830696.576502:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25519b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3689682b-484d-410c-a8fd-1b98c0369c65+16:15860:x1875724595196032:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788830696.576513:0:14458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788830696.576527:0:14458:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2565729200/0x575506951eea1cae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x575506951eea1ca7 expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830696.576551:0:14458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2565729200/0x575506951eea1cae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x575506951eea1ca7 expref: 17 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830696.576561:0:14458:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2565729200/0x575506951eea1cae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x575506951eea1ca7 expref: 17 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830696.576570:0:14458:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2565729200, rc 0) 00000100:00100000:2.0:1788830696.576617:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25519b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3689682b-484d-410c-a8fd-1b98c0369c65+17:15860:x1875724595196032:12345-0@lo:101:mount.lustre.0 Request processed in 115us (748us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830696.576623:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788830696.576727:0:15860:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25747c2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3689682b-484d-410c-a8fd-1b98c0369c65:15860:1875724595196032:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788830696.576740:0:15860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.121@tcp lock: ffff9e257fa8cc00/0x575506951eea1ca7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea1cae expref: -99 pid: 15860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830696.576749:0:15860:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.121@tcp lock: ffff9e257fa8cc00/0x575506951eea1ca7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x575506951eea1cae expref: -99 pid: 15860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788830696.577569:0:15860:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1788830696.578835:0:15860:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788830696.579214:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1788830696.579347:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1788830696.579401:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1788830696.579470:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1788830696.579509:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1788830696.579544:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1788830696.579613:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1788830696.579622:0:15860:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1788830696.579705:0:15860:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25747c2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3689682b-484d-410c-a8fd-1b98c0369c65:15860:1875724595196160:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788830696.579811:0:15860:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830696.579847:0:15860:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e254747fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788830696.579925:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595196160 00000100:00100000:0.0:1788830696.579933:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595196160 00000100:00100000:0.0:1788830696.579989:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788830696.579998:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25519b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3689682b-484d-410c-a8fd-1b98c0369c65+17:15860:x1875724595196160:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788830696.580515:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25519b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3689682b-484d-410c-a8fd-1b98c0369c65+17:15860:x1875724595196160:12345-0@lo:501:mount.lustre.0 Request processed in 516us (703us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830696.580524:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788830696.580670:0:15860:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25747c2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3689682b-484d-410c-a8fd-1b98c0369c65:15860:1875724595196160:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788830696.580772:0:15860:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25747c2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3689682b-484d-410c-a8fd-1b98c0369c65:15860:1875724595196288:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788830696.580811:0:15860:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830696.580842:0:15860:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e254747fcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788830696.580927:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595196288 00000100:00100000:2.0:1788830696.580932:0:14455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595196288 00000100:00100000:2.0:1788830696.580971:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788830696.580979:0:14455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25519b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3689682b-484d-410c-a8fd-1b98c0369c65+17:15860:x1875724595196288:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788830696.581484:0:14455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25519b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3689682b-484d-410c-a8fd-1b98c0369c65+17:15860:x1875724595196288:12345-0@lo:503:mount.lustre.0 Request processed in 504us (671us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830696.581490:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788830696.581572:0:15860:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25747c2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3689682b-484d-410c-a8fd-1b98c0369c65:15860:1875724595196288:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788830696.582922:0:15860:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788830696.583002:0:15860:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25747c2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3689682b-484d-410c-a8fd-1b98c0369c65:15860:1875724595196416:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788830696.583063:0:15860:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830696.583234:0:15860:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e254747fcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788830696.583336:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595196416 00000100:00100000:2.0:1788830696.583343:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595196416 00000100:00100000:2.0:1788830696.583442:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788830696.583452:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25519b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3689682b-484d-410c-a8fd-1b98c0369c65+17:15860:x1875724595196416:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788830696.583661:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25519b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3689682b-484d-410c-a8fd-1b98c0369c65+17:15860:x1875724595196416:12345-0@lo:502:mount.lustre.0 Request processed in 210us (597us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830696.583670:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788830696.583785:0:15860:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25747c2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3689682b-484d-410c-a8fd-1b98c0369c65:15860:1875724595196416:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788830696.584028:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1788830696.584095:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1788830696.584133:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1788830696.584184:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1788830696.584221:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1788830696.584269:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1788830696.584327:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1788830696.584367:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1788830696.584431:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:1.0:1788830696.584463:0:15860:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25747c2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3689682b-484d-410c-a8fd-1b98c0369c65:15860:1875724595196544:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788830696.584508:0:15860:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830696.584859:0:15860:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e254747fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788830696.584935:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595196544 00000100:00100000:0.0:1788830696.584943:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595196544 00000100:00100000:0.0:1788830696.584976:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788830696.584984:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25519b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3689682b-484d-410c-a8fd-1b98c0369c65+17:15860:x1875724595196544:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788830696.585334:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25519b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3689682b-484d-410c-a8fd-1b98c0369c65+17:15860:x1875724595196544:12345-0@lo:502:mount.lustre.0 Request processed in 349us (824us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830696.585342:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788830696.585467:0:15860:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25747c2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3689682b-484d-410c-a8fd-1b98c0369c65:15860:1875724595196544:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788830696.585552:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:1.0:1788830696.585564:0:15860:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:1.0:1788830696.586449:0:15861:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788830696.586459:0:15861:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1788830696.586471:0:15861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788830696.586473:0:15861:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1788830696.586480:0:15861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788830696.586495:0:15861:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9e25474f3370) 00000020:00000080:1.0:1788830696.586516:0:15861:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788830696.586523:0:15861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788830696.586584:0:15861:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e2545177800 from lustre-OST0001, refs=2 00080000:01000000:1.0:1788830696.586591:0:15861:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788830696.586598:0:15861:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x575506951eea1cbc 00010000:00010000:1.0:1788830696.591613:0:15861:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:1.0:1788830696.594565:0:15861:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:1.0:1788830696.597675:0:15861:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:1.0:1788830696.599352:0:15861:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1788830696.599366:0:15861:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788830696.599373:0:15861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788830696.599376:0:15861:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1788830696.599379:0:15861:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788830696.599392:0:15861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788830696.599393:0:15861:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788830696.599397:0:15861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788830696.599399:0:15861:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788830696.599401:0:15861:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788830696.599404:0:15861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788830696.599405:0:15861:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788830696.599407:0:15861:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788830696.599410:0:15861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788830696.599411:0:15861:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788830696.599414:0:15861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1788830696.599474:0:15861:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788830696.599478:0:15861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788830696.599479:0:15861:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788830696.599482:0:15861:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:3.0:1788830696.600846:0:15860:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:3.0:1788830696.600883:0:15860:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.121@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1788830696.600910:0:15860:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: ffff9e257fa8cc00/0x575506951eea1ca7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea1cae expref: -99 pid: 15860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830696.600925:0:15860:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.121@tcp lock: ffff9e257fa8cc00/0x575506951eea1ca7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea1cae expref: -99 pid: 15860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788830696.600934:0:15860:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e2545177800 from 1 10000000:01000000:3.0:1788830696.600937:0:15860:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788830696.600985:0:15860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.121@tcp lock: ffff9e257d944400/0x575506951eea1cc3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830696.600994:0:15860:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.121@tcp lock: ffff9e257d944400/0x575506951eea1cc3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830696.601006:0:15860:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.121@tcp lock: ffff9e257d944400/0x575506951eea1cc3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788830696.601032:0:15860:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2545cbdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3689682b-484d-410c-a8fd-1b98c0369c65:15860:1875724595196672:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788830696.601373:0:15860:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830696.601435:0:15860:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2545c710c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788830696.602205:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595196672 00000100:00100000:1.0:1788830696.602221:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595196672 00000100:00100000:1.0:1788830696.602348:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788830696.602359:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25519b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3689682b-484d-410c-a8fd-1b98c0369c65+17:15860:x1875724595196672:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788830696.602376:0:14457:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788830696.602402:0:14457:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e257fa8ce00/0x575506951eea1cca lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x575506951eea1cc3 expref: -99 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830696.602427:0:14457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e257fa8ce00/0x575506951eea1cca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x575506951eea1cc3 expref: 18 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830696.602439:0:14457:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e257fa8ce00/0x575506951eea1cca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x575506951eea1cc3 expref: 18 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830696.602449:0:14457:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e257fa8ce00, rc 0) 00000100:00100000:1.0:1788830696.602500:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25519b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3689682b-484d-410c-a8fd-1b98c0369c65+18:15860:x1875724595196672:12345-0@lo:101:mount.lustre.0 Request processed in 142us (1126us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830696.602507:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788830696.602615:0:15860:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2545cbdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3689682b-484d-410c-a8fd-1b98c0369c65:15860:1875724595196672:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788830696.602631:0:15860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.121@tcp lock: ffff9e257d944400/0x575506951eea1cc3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea1cca expref: -99 pid: 15860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830696.602641:0:15860:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.121@tcp lock: ffff9e257d944400/0x575506951eea1cc3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x575506951eea1cca expref: -99 pid: 15860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788830696.603589:0:15860:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1788830696.606701:0:15860:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788830696.607019:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1788830696.607066:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1788830696.610898:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1788830696.610919:0:15860:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1788830696.611030:0:15860:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2545cbdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3689682b-484d-410c-a8fd-1b98c0369c65:15860:1875724595196800:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788830696.611809:0:15860:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830696.611867:0:15860:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2545c710c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788830696.612022:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595196800 00000100:00100000:2.0:1788830696.612031:0:14455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595196800 00000100:00100000:2.0:1788830696.612091:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788830696.612101:0:14455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25519b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3689682b-484d-410c-a8fd-1b98c0369c65+18:15860:x1875724595196800:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788830696.612487:0:14455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25519b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3689682b-484d-410c-a8fd-1b98c0369c65+18:15860:x1875724595196800:12345-0@lo:501:mount.lustre.0 Request processed in 386us (679us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830696.612495:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788830696.612591:0:15860:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2545cbdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3689682b-484d-410c-a8fd-1b98c0369c65:15860:1875724595196800:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788830696.612639:0:15860:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2545cbdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3689682b-484d-410c-a8fd-1b98c0369c65:15860:1875724595196928:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788830696.612680:0:15860:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830696.614559:0:15860:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2545c710c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788830696.615732:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595196928 00000100:00100000:2.0:1788830696.615744:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595196928 00000100:00100000:2.0:1788830696.615797:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788830696.615808:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25519b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3689682b-484d-410c-a8fd-1b98c0369c65+18:15860:x1875724595196928:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788830696.616032:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25519b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3689682b-484d-410c-a8fd-1b98c0369c65+18:15860:x1875724595196928:12345-0@lo:503:mount.lustre.0 Request processed in 225us (3350us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830696.616040:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788830696.616578:0:15860:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2545cbdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3689682b-484d-410c-a8fd-1b98c0369c65:15860:1875724595196928:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788830696.617098:0:15860:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788830696.617175:0:15860:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2545cbdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3689682b-484d-410c-a8fd-1b98c0369c65:15860:1875724595197056:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788830696.617230:0:15860:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830696.617260:0:15860:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2545c710c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788830696.617483:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595197056 00000100:00100000:0.0:1788830696.617490:0:14455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595197056 00000100:00100000:0.0:1788830696.617517:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788830696.617526:0:14455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2444969450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3689682b-484d-410c-a8fd-1b98c0369c65+18:15860:x1875724595197056:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788830696.617704:0:14455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2444969450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3689682b-484d-410c-a8fd-1b98c0369c65+18:15860:x1875724595197056:12345-0@lo:502:mount.lustre.0 Request processed in 178us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830696.617730:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788830696.617821:0:15860:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2545cbdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3689682b-484d-410c-a8fd-1b98c0369c65:15860:1875724595197056:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788830696.618138:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1788830696.618188:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1788830696.618240:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1788830696.618444:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1788830696.618482:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1788830696.618534:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1788830696.618573:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1788830696.618607:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:3.0:1788830696.618636:0:15860:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2545cbdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3689682b-484d-410c-a8fd-1b98c0369c65:15860:1875724595197184:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788830696.618680:0:15860:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830696.618797:0:15860:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2545c710c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788830696.619045:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595197184 00000100:00100000:1.0:1788830696.619052:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595197184 00000100:00100000:1.0:1788830696.619210:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788830696.619219:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2444ad4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3689682b-484d-410c-a8fd-1b98c0369c65+18:15860:x1875724595197184:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788830696.619417:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2444ad4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3689682b-484d-410c-a8fd-1b98c0369c65+18:15860:x1875724595197184:12345-0@lo:502:mount.lustre.0 Request processed in 199us (737us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830696.619424:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788830696.619497:0:15860:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2545cbdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3689682b-484d-410c-a8fd-1b98c0369c65:15860:1875724595197184:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788830696.619591:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1788830696.619601:0:15860:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:0.0:1788830696.620629:0:15865:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788830696.620640:0:15865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788830696.620642:0:15865:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788830696.620649:0:15865:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e2545177800 00000020:00000080:0.0:1788830696.620651:0:15865:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788830696.620658:0:15865:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788830696.620660:0:15865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788830696.620661:0:15865:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788830696.620664:0:15865:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788830696.620666:0:15865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788830696.620667:0:15865:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788830696.620671:0:15865:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e2545177800 00000020:00000080:0.0:1788830696.620673:0:15865:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788830696.620747:0:15865:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788830696.620751:0:15865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788830696.620753:0:15865:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788830696.620755:0:15865:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788830696.620758:0:15865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788830696.620759:0:15865:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788830696.620763:0:15865:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9e2545177800 00000020:00000080:0.0:1788830696.620765:0:15865:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788830696.620796:0:15865:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788830696.620800:0:15865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788830696.620802:0:15865:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1788830696.620805:0:15865:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:2.0:1788830696.620947:0:15860:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1788830696.620978:0:15860:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788830696.621001:0:15860:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: ffff9e257d944400/0x575506951eea1cc3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea1cca expref: -99 pid: 15860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830696.621014:0:15860:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.121@tcp lock: ffff9e257d944400/0x575506951eea1cc3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea1cca expref: -99 pid: 15860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788830696.621055:0:15860:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788830696.621058:0:15860:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9e2545177800 10000000:01000000:2.0:1788830696.621067:0:15860:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9e2545177800 10000000:01000000:2.0:1788830696.621082:0:15860:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788830696.621088:0:15860:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9e2545177800 from 1 10000000:01000000:2.0:1788830696.621090:0:15860:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788830696.621119:0:15860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.121@tcp lock: ffff9e2565729a00/0x575506951eea1cd1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830696.621128:0:15860:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.121@tcp lock: ffff9e2565729a00/0x575506951eea1cd1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830696.621139:0:15860:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.121@tcp lock: ffff9e2565729a00/0x575506951eea1cd1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788830696.621159:0:15860:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25658c2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3689682b-484d-410c-a8fd-1b98c0369c65:15860:1875724595197312:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788830696.621208:0:15860:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788830696.621243:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595197312 00000100:00100000:2.0:1788830696.621249:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595197312 00000100:00100000:2.0:1788830696.621563:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788830696.621572:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2444ad7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3689682b-484d-410c-a8fd-1b98c0369c65+18:15860:x1875724595197312:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788830696.621584:0:14458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788830696.621597:0:14458:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2565729600/0x575506951eea1cd8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x575506951eea1cd1 expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830696.621620:0:14458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2565729600/0x575506951eea1cd8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x575506951eea1cd1 expref: 19 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830696.621630:0:14458:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2565729600/0x575506951eea1cd8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x575506951eea1cd1 expref: 19 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830696.621638:0:14458:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2565729600, rc 0) 00000100:00100000:2.0:1788830696.621676:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2444ad7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3689682b-484d-410c-a8fd-1b98c0369c65+19:15860:x1875724595197312:12345-0@lo:101:mount.lustre.0 Request processed in 104us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830696.621683:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788830696.621749:0:15860:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2548064e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788830696.621767:0:15860:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25658c2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3689682b-484d-410c-a8fd-1b98c0369c65:15860:1875724595197312:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788830696.621779:0:15860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.121@tcp lock: ffff9e2565729a00/0x575506951eea1cd1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea1cd8 expref: -99 pid: 15860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830696.621788:0:15860:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.121@tcp lock: ffff9e2565729a00/0x575506951eea1cd1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x575506951eea1cd8 expref: -99 pid: 15860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788830696.623601:0:15860:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:2.0:1788830696.624054:0:15860:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788830696.625908:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1788830696.625953:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1788830696.625994:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1788830696.626031:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1788830696.626059:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1788830696.626112:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1788830696.626141:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1788830696.626166:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1788830696.626203:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1788830696.626239:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1788830696.626288:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1788830696.626336:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1788830696.626373:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1788830696.626423:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1788830696.626472:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1788830696.626511:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1788830696.626546:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1788830696.626593:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1788830696.626648:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1788830696.626676:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1788830696.626737:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1788830696.626768:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1788830696.626794:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1788830696.626832:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1788830696.626859:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:2.0:1788830696.626884:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:2.0:1788830696.626920:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:2.0:1788830696.626947:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:2.0:1788830696.626972:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:2.0:1788830696.627007:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:2.0:1788830696.627033:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:2.0:1788830696.627059:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:2.0:1788830696.627083:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:2.0:1788830696.627118:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:2.0:1788830696.627160:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:2.0:1788830696.627199:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:2.0:1788830696.627231:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:2.0:1788830696.627299:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:2.0:1788830696.627306:0:15860:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:2.0:1788830696.633654:0:15860:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25658c2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3689682b-484d-410c-a8fd-1b98c0369c65:15860:1875724595197440:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788830696.633740:0:15860:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788830696.633791:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595197440 00000100:00100000:2.0:1788830696.633799:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595197440 00000100:00100000:2.0:1788830696.633856:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788830696.633865:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2444ad6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3689682b-484d-410c-a8fd-1b98c0369c65+19:15860:x1875724595197440:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788830696.634216:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2444ad6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3689682b-484d-410c-a8fd-1b98c0369c65+19:15860:x1875724595197440:12345-0@lo:501:mount.lustre.0 Request processed in 351us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830696.634224:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788830696.634359:0:15860:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2548064e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788830696.634391:0:15860:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25658c2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3689682b-484d-410c-a8fd-1b98c0369c65:15860:1875724595197440:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788830696.634433:0:15860:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25658c2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3689682b-484d-410c-a8fd-1b98c0369c65:15860:1875724595197568:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788830696.634473:0:15860:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788830696.640237:0:15860:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2548064e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788830696.648218:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595197568 00000100:00100000:3.0:1788830696.648234:0:14455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595197568 00000100:00100000:3.0:1788830696.648301:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788830696.648319:0:14455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2444ad6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3689682b-484d-410c-a8fd-1b98c0369c65+19:15860:x1875724595197568:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788830696.648584:0:14455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2444ad6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3689682b-484d-410c-a8fd-1b98c0369c65+19:15860:x1875724595197568:12345-0@lo:503:mount.lustre.0 Request processed in 266us (14109us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830696.648592:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788830696.648814:0:15860:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25658c2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3689682b-484d-410c-a8fd-1b98c0369c65:15860:1875724595197568:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788830696.649672:0:15860:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788830696.649774:0:15860:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2545cbdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3689682b-484d-410c-a8fd-1b98c0369c65:15860:1875724595197696:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788830696.649830:0:15860:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830696.649868:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595197696 00000100:00100000:3.0:1788830696.649873:0:14455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595197696 00000100:00100000:3.0:1788830696.649904:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788830696.649912:0:14455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2444872850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3689682b-484d-410c-a8fd-1b98c0369c65+19:15860:x1875724595197696:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788830696.650793:0:15860:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2545c71240 going to sleep for 11 seconds 00000100:00100000:3.0:1788830696.652345:0:14455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2444872850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3689682b-484d-410c-a8fd-1b98c0369c65+19:15860:x1875724595197696:12345-0@lo:502:mount.lustre.0 Request processed in 2426us (2508us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830696.652359:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788830696.652641:0:15860:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2545cbdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3689682b-484d-410c-a8fd-1b98c0369c65:15860:1875724595197696:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788830696.653023:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1788830696.654497:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1788830696.654565:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1788830696.654630:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1788830696.654669:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1788830696.654911:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1788830696.654954:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1788830696.654988:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1788830696.655031:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1788830696.655061:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1788830696.655173:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1788830696.655223:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1788830696.655762:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1788830696.655808:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1788830696.655881:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1788830696.655915:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1788830696.655946:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1788830696.655995:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1788830696.656031:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1788830696.656066:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1788830696.657000:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1788830696.657044:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1788830696.657182:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1788830696.657252:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1788830696.657405:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:2.0:1788830696.657445:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:2.0:1788830696.657498:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:2.0:1788830696.657536:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:2.0:1788830696.657573:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:2.0:1788830696.657640:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:2.0:1788830696.657697:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:2.0:1788830696.657759:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:2.0:1788830696.657795:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:2.0:1788830696.657858:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:2.0:1788830696.657901:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:2.0:1788830696.657955:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:2.0:1788830696.657994:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:2.0:1788830696.658032:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:2.0:1788830696.658238:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:2.0:1788830696.658364:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:2.0:1788830696.658432:0:15860:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25658c3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3689682b-484d-410c-a8fd-1b98c0369c65:15860:1875724595197824:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788830696.658513:0:15860:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788830696.658613:0:15860:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2548064240 going to sleep for 11 seconds 00000100:00100000:0.0:1788830696.658903:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595197824 00000100:00100000:0.0:1788830696.658912:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595197824 00000100:00100000:0.0:1788830696.658966:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788830696.658975:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2444873050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3689682b-484d-410c-a8fd-1b98c0369c65+19:15860:x1875724595197824:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788830696.659419:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2444873050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3689682b-484d-410c-a8fd-1b98c0369c65+19:15860:x1875724595197824:12345-0@lo:502:mount.lustre.0 Request processed in 443us (905us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830696.659427:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788830696.659504:0:15860:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25658c3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3689682b-484d-410c-a8fd-1b98c0369c65:15860:1875724595197824:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788830696.659579:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:2.0:1788830696.659590:0:15860:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:2.0:1788830696.660562:0:15870:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1788830696.660578:0:15870:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9e2544828000) 00000020:00000080:2.0:1788830696.660602:0:15870:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:2.0:1788830696.660680:0:15870:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e2545177800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788830696.660684:0:15870:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e2545177800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788830696.660686:0:15870:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e2545177800 3 00010000:00080000:2.0:1788830696.660738:0:15870:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e2444b3d000@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.121@tcp at head 00010000:00010000:2.0:1788830696.662778:0:15870:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:2.0:1788830696.662980:0:15870:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1788830696.663016:0:15870:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788830696.663030:0:15870:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x575506951eea1ce6 00000100:00080000:2.0:1788830696.663040:0:15870:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788830696.663045:0:15870:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9e2444b3d000 using connection 192.168.201.121@tcp/0@lo 00000100:00100000:2.0:1788830696.663220:0:15870:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e25658c3480 x1875724595197952/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788830696.663272:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25658c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3306:1875724595197952:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788830696.663342:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788830696.663411:0:15870:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788830696.663931:0:14464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595197952 00000100:00100000:0.0:1788830696.663939:0:14464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595197952 00000100:00100000:0.0:1788830696.663973:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788830696.663980:0:14464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25658c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3306:x1875724595197952:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788830696.664004:0:14464:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 450 last 0 00000020:00000080:0.0:1788830696.664053:0:14464:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x575506951eea1ced 00000004:00100000:0.0:1788830696.664080:0:14464:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788830696.664113:0:14464:0:(import.c:65:import_set_state_nolock()) ffff9e244485e800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788830696.664166:0:14464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25658c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875724595197952:12345-0@lo:38:llog_process_th.0 Request processed in 185us (825us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830696.664174:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788830696.664233:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e25658c3480 x1875724595197952/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788830706 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788830696.664243:0:3306:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788830696.664252:0:3306:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:0.0:1788830696.664272:0:3306:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788830696.664276:0:3306:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788830696.664278:0:3306:0:(import.c:65:import_set_state_nolock()) ffff9e2444b3d000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788830696.664284:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25658c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3306:1875724595197952:0@lo:38:llog_process_th.0 00000100:00080000:0.0:1788830696.664318:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788830696.664323:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788830696.664333:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788830696.664336:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788830696.664406:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25478b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875724595198080:0@lo:400:kworker.0 00000100:00100000:0.0:1788830696.664437:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830696.664471:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25478b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875724595198208:0@lo:400:kworker.0 00000100:00100000:0.0:1788830696.664498:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830696.664527:0:14463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595198080 00000100:00100000:0.0:1788830696.664531:0:14463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595198080 00000100:00100000:0.0:1788830696.664558:0:14463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595198208 00000100:00100000:0.0:1788830696.664561:0:14463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595198208 00000100:00100000:0.0:1788830696.664584:0:14463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788830696.664590:0:14463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25478b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875724595198080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788830696.664628:0:14463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25478b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875724595198080:12345-0@lo:400:kworker.0 Request processed in 38us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830696.664635:0:14463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788830696.664647:0:14463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788830696.664653:0:14463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25478b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875724595198208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788830696.664683:0:14463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25478b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875724595198208:12345-0@lo:400:kworker.0 Request processed in 31us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830696.664689:0:14463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:0.0:1788830696.664703:0:14459:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788830696.664747:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e25478b7800 x1875724595198208/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788830712 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788830696.664756:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25478b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875724595198208:0@lo:400:kworker.0 00010000:00080000:0.0:1788830696.664778:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e25478b6300 x1875724595198080/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788830712 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788830696.664794:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25478b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875724595198080:0@lo:400:kworker.0 00000040:00080000:3.0:1788830696.667348:0:15870:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:0.0:1788830696.672976:0:15860:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1788830696.673013:0:15860:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.121@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788830696.673082:0:15860:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: ffff9e2565729a00/0x575506951eea1cd1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea1cd8 expref: -99 pid: 15860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830696.673093:0:15860:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.121@tcp lock: ffff9e2565729a00/0x575506951eea1cd1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea1cd8 expref: -99 pid: 15860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788830696.673356:0:15860:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788830696.673358:0:15860:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788830696.673360:0:15860:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788830696.673361:0:15860:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788830696.673363:0:15860:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788830696.673364:0:15860:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788830696.673366:0:15860:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788830696.673368:0:15860:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788830696.673369:0:15860:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788830696.673372:0:15860:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:0.0:1788830696.673375:0:15860:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788830696.673376:0:15860:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788830696.673388:0:15860:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788830696.673389:0:15860:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788830696.673391:0:15860:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788830696.673392:0:15860:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788830696.673393:0:15860:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788830696.673394:0:15860:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788830696.673395:0:15860:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788830696.673424:0:15860:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1788830696.673445:0:15860:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25478b6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3689682b-484d-410c-a8fd-1b98c0369c65:15860:1875724595198336:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788830696.673523:0:15860:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830696.673577:0:15860:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e25501a73c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788830696.674019:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595198336 00000100:00100000:3.0:1788830696.674027:0:14455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595198336 00000100:00100000:3.0:1788830696.674094:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788830696.674104:0:14455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2444870450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3689682b-484d-410c-a8fd-1b98c0369c65+19:15860:x1875724595198336:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788830696.674131:0:14455:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1788830696.674146:0:14455:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788830696.697491:0:14455:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788830696.697512:0:14455:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1788830696.697605:0:14479:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788830696.697623:0:14479:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788830696.697645:0:14479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e25658d6200/0x575506951eea1cf4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830696.697664:0:14479:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e257d944a00/0x575506951eea1c92 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x575506951eea1c8b expref: 19 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830696.697673:0:14479:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e25658d6200/0x575506951eea1cf4 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830696.697743:0:14479:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e257d944a00/0x575506951eea1c92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x575506951eea1c8b expref: 19 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830696.697759:0:14479:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e257d944a00/0x575506951eea1c92 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x575506951eea1c8b expref: 19 pid: 14457 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788830696.697773:0:14479:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25478b7800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14479:1875724595198464:0@lo:104: 00000100:00100000:0.0:1788830696.697841:0:14479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830696.697946:0:14479:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2544f05180 going to sleep for 11 seconds 00000100:00100000:2.0:1788830696.701152:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595198464 00000100:00100000:2.0:1788830696.701168:0:14446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595198464 00000100:00100000:2.0:1788830696.701421:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788830696.701433:0:14446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25478b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3689682b-484d-410c-a8fd-1b98c0369c65+3:14479:x1875724595198464:12345-0@lo:104: 00010000:00010000:2.0:1788830696.701451:0:14446:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.121@tcp lock: ffff9e25658d6a00/0x575506951eea1c8b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x575506951eea1c92 expref: -99 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830696.701553:0:14446:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788830696.701560:0:14446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25478b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3689682b-484d-410c-a8fd-1b98c0369c65+3:14479:x1875724595198464:12345-0@lo:104: Request processed in 130us (3718us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830696.701566:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788830696.701650:0:14479:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25478b7800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14479:1875724595198464:0@lo:104: 00010000:00010000:0.0:1788830696.701676:0:14479:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e25658d6200/0x575506951eea1cf4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830696.702629:0:14452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788830696.702637:0:14452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.121@tcp lock: ffff9e25658d6a00/0x575506951eea1c8b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x575506951eea1c92 expref: -99 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830696.702647:0:14452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e25658d6a00 already unused, calling callback (ffffffffc1aebc20) 10000000:00010000:2.0:1788830696.702652:0:14452:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.121@tcp lock: ffff9e25658d6a00/0x575506951eea1c8b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x575506951eea1c92 expref: -99 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830696.702676:0:14452:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.121@tcp lock: ffff9e25658d6a00/0x575506951eea1c8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x575506951eea1c92 expref: -99 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788830696.702683:0:14452:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.121@tcp lock: ffff9e25658d6a00/0x575506951eea1c8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x575506951eea1c92 expref: -99 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788830696.702689:0:14452:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788830696.702746:0:14452:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.121@tcp lock: ffff9e25658d6a00/0x575506951eea1c8b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x575506951eea1c92 expref: -99 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830696.702753:0:14452:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788830696.702773:0:14452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.121@tcp lock: ffff9e25658d6a00/0x575506951eea1c8b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x575506951eea1c92 expref: -99 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830696.702779:0:14452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.121@tcp lock: ffff9e25658d6a00/0x575506951eea1c8b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x575506951eea1c92 expref: -99 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830696.702795:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788830696.702797:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788830696.702798:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788830696.702812:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25658c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3689682b-484d-410c-a8fd-1b98c0369c65:3310:1875724595198592:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788830696.702857:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788830696.702920:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595198592 00000100:00100000:2.0:1788830696.702925:0:14449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595198592 00010000:00010000:2.0:1788830696.702944:0:14449:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e257d944a00/0x575506951eea1c92 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x575506951eea1c8b expref: 20 pid: 14457 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788830696.702967:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788830696.702974:0:14449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25658c2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3689682b-484d-410c-a8fd-1b98c0369c65+20:3310:x1875724595198592:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788830696.702992:0:14449:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788830696.702998:0:14449:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e257d944a00/0x575506951eea1c92 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x575506951eea1c8b expref: 20 pid: 14457 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830696.703008:0:14449:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e257d944a00/0x575506951eea1c92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x575506951eea1c8b expref: 20 pid: 14457 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830696.703021:0:14449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e257d944a00/0x575506951eea1c92 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x575506951eea1c8b expref: 20 pid: 14457 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830696.703034:0:14449:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e25658d6200/0x575506951eea1cf4 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830696.703042:0:14449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e25658d6200/0x575506951eea1cf4 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788830696.703056:0:14449:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005433774s 00010000:00010000:2.0:1788830696.703060:0:14449:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e25658d6200/0x575506951eea1cf4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830696.703067:0:14449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e25658d6200/0x575506951eea1cf4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830696.703086:0:14449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e25658d6200/0x575506951eea1cf4 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830696.703092:0:14449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e25658d6200/0x575506951eea1cf4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830696.703097:0:14449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e25658d6200 already unused, calling callback (ffffffffc14cb350) 00010000:00010000:2.0:1788830696.703101:0:14449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e25658d6200/0x575506951eea1cf4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830696.703114:0:14449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e25658d6200/0x575506951eea1cf4 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830696.703128:0:14449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e25658d6200/0x575506951eea1cf4 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830696.703136:0:14449:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788830696.703168:0:14449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25658c2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3689682b-484d-410c-a8fd-1b98c0369c65+19:3310:x1875724595198592:12345-0@lo:103:ldlm_bl.0 Request processed in 194us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830696.703174:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788830696.703208:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25658c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3689682b-484d-410c-a8fd-1b98c0369c65:3310:1875724595198592:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788830696.703227:0:14479:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e25658d6200/0x575506951eea1cf4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830696.703234:0:14479:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e25658d6200/0x575506951eea1cf4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830696.703240:0:14479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e25658d6200/0x575506951eea1cf4 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788830696.708361:0:14455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2444870450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3689682b-484d-410c-a8fd-1b98c0369c65+18:15860:x1875724595198336:12345-0@lo:253:mount.lustre.0 Request processed in 34249us (34828us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830696.708377:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788830696.708533:0:15860:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25478b6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3689682b-484d-410c-a8fd-1b98c0369c65:15860:1875724595198336:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788830696.708550:0:15860:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788830696.708554:0:15860:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788830696.708555:0:15860:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788830696.708557:0:15860:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788830696.708558:0:15860:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788830696.708559:0:15860:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788830696.708561:0:15860:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788830696.708575:0:15860:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788830696.708576:0:15860:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788830696.708578:0:15860:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788830696.708593:0:15860:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788830696.714447:0:15860:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1788830696.714621:0:15860:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788830696.714856:0:15860:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1788830696.715012:0:15860:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1788830696.715248:0:15860:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1788830696.715582:0:15860:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1788830696.716654:0:15860:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1788830696.757995:0:15860:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1788830696.758002:0:15860:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1788830696.758029:0:15860:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788830696.758208:0:15860:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.121@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788830696.758223:0:15860:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1788830696.758262:0:15860:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:3.0:1788830697.180960:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788830697.692693:0:3306:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788830682/real 1788830682] req@ffff9e2545cbfb80 x1875724595191424/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788830697 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788830697.692734:0:3306:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e2545cbfb80 x1875724595191424/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788830697 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788830697.692755:0:3306:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788830682/real 1788830682] req@ffff9e2545cbc700 x1875724595191552/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788830697 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788830697.692766:0:3306:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e2545cbc700 x1875724595191552/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788830697 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788830697.692784:0:3306:0:(import.c:65:import_set_state_nolock()) ffff9e2548331000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788830697.692797:0:3306:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788830697.692800:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2545cbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1875724595191424:0@lo:8:kworker.0 00000100:00080000:3.0:1788830697.692805:0:3306:0:(import.c:65:import_set_state_nolock()) ffff9e25430e7800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788830697.692809:0:3306:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788830697.692812:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2545cbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1875724595191552:0@lo:8:kworker.0 00000100:00080000:3.0:1788830697.692869:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788830697.692873:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788830697.692875:0:38:0:(import.c:65:import_set_state_nolock()) ffff9e2548331000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788830697.692879:0:38:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 435 00000100:00080000:3.0:1788830697.692884:0:38:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788830697.692890:0:38:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9e2548331000 using connection 192.168.201.121@tcp/0@lo 00000100:00100000:3.0:1788830697.692907:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e2545cbfb80 x1875724595198848/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788830697.692917:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788830697.692920:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788830697.692921:0:38:0:(import.c:65:import_set_state_nolock()) ffff9e25430e7800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788830697.692924:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 435 00000100:00080000:3.0:1788830697.692926:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788830697.692934:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9e25430e7800 using connection 192.168.201.121@tcp/0@lo 00000100:00100000:3.0:1788830697.692946:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e2545cbe680 x1875724595198976/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788830697.692995:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2545cbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3689682b-484d-410c-a8fd-1b98c0369c65:3307:1875724595198720:0@lo:400:kworker.0 00000100:00100000:3.0:1788830697.693059:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830697.693116:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788830697.693123:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2545cbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875724595199104:0@lo:400:kworker.0 00000100:00100000:3.0:1788830697.693150:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830697.693179:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2545cbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1875724595198848:0@lo:8:kworker.0 00000100:00100000:3.0:1788830697.693203:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830697.693220:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2545cbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1875724595198976:0@lo:8:kworker.0 00000100:00100000:3.0:1788830697.693240:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830697.693264:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2545cbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875724595199232:0@lo:400:kworker.0 00000100:00100000:3.0:1788830697.693286:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830697.693305:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788830697.693310:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2545cbdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1875724595199360:0@lo:400:kworker.0 00000100:00100000:3.0:1788830697.693334:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830697.693376:0:14463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595199104 00000100:00100000:3.0:1788830697.693384:0:14463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595199104 00000100:00100000:3.0:1788830697.693421:0:14463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595199232 00000100:00100000:3.0:1788830697.693423:0:14463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595199232 00000100:00100000:3.0:1788830697.693435:0:14463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595199360 00000100:00100000:3.0:1788830697.693437:0:14463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595199360 00000100:00100000:3.0:1788830697.693463:0:14463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788830697.693472:0:14463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2545cbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875724595199104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788830697.693519:0:14463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2545cbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875724595199104:12345-0@lo:400:kworker.0 Request processed in 48us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830697.693762:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595198720 00000100:00100000:2.0:1788830697.693766:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595198720 00000100:00100000:2.0:1788830697.693793:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788830697.693800:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2444872450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3689682b-484d-410c-a8fd-1b98c0369c65+18:3307:x1875724595198720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788830697.693830:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2444872450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3689682b-484d-410c-a8fd-1b98c0369c65+18:3307:x1875724595198720:12345-0@lo:400:kworker.0 Request processed in 31us (771us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830697.693835:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788830697.694023:0:15145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595198848 00000100:00100000:0.0:1788830697.694028:0:15145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595198848 00000100:00100000:0.0:1788830697.694086:0:15145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595198976 00000100:00100000:0.0:1788830697.694089:0:15145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595198976 00000100:00100000:3.0:1788830697.695450:0:14463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788830697.695492:0:14463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788830697.695503:0:14463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2545cbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875724595199232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788830697.696682:0:14463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2545cbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875724595199232:12345-0@lo:400:kworker.0 Request processed in 1179us (3391us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830697.696693:0:14463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788830697.696728:0:14463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788830697.696737:0:14463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2545cbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875724595199360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788830697.696772:0:14463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2545cbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875724595199360:12345-0@lo:400:kworker.0 Request processed in 38us (3437us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830697.696778:0:14463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788830697.696900:0:15146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788830697.696906:0:15146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2545cbe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3306:x1875724595198848:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1788830697.696929:0:15146:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 451 last 0 00000020:00000080:2.0:1788830697.696955:0:15146:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x575506951eea1cfb 00002000:00100000:2.0:1788830697.696968:0:15146:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9e2444b3b800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113968 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1788830697.696973:0:15146:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1788830697.696975:0:15146:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788830697.697284:0:15146:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788830697.697306:0:15146:0:(import.c:65:import_set_state_nolock()) ffff9e2444b3f000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788830697.697352:0:15146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2545cbe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3306:x1875724595198848:12345-0@lo:8:kworker.0 Request processed in 445us (4148us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830697.697359:0:15146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788830697.697388:0:15146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788830697.697399:0:15146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2545cbf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3306:x1875724595198976:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1788830697.697414:0:15146:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 451 last 0 00000020:00000080:2.0:1788830697.697429:0:15146:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x575506951eea1d02 00002000:00100000:2.0:1788830697.697435:0:15146:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9e2444b3f800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113968 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1788830697.697438:0:15146:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1788830697.697440:0:15146:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788830697.697642:0:15146:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788830697.697655:0:15146:0:(import.c:65:import_set_state_nolock()) ffff9e2444b3d800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788830697.697687:0:15146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2545cbf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3306:x1875724595198976:12345-0@lo:8:kworker.0 Request processed in 286us (4445us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830697.697694:0:15146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788830697.697943:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e2545cbfb80 x1875724595198848/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788830717 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788830697.697954:0:3306:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788830697.697963:0:3306:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1788830697.697970:0:3306:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788830697.697975:0:3306:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1788830697.697977:0:3306:0:(import.c:65:import_set_state_nolock()) ffff9e2548331000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788830697.697993:0:3306:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788830697.697998:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2545cbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1875724595198848:0@lo:8:kworker.0 00010000:00080000:2.0:1788830697.698017:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e2545cbe680 x1875724595198976/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788830717 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788830697.698024:0:3306:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788830697.698028:0:3306:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1788830697.698032:0:3306:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788830697.698035:0:3306:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1788830697.698043:0:3306:0:(import.c:65:import_set_state_nolock()) ffff9e25430e7800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788830697.698063:0:3306:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788830697.698067:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2545cbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1875724595198976:0@lo:8:kworker.0 00000004:00080000:1.0:1788830697.701816:0:14487:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788830697.702147:0:14487:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 451049436809ns, next at 0ns, rc = 0 00010000:00080000:2.0:1788830697.702604:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e2545cbca80 x1875724595199104/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788830713 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788830697.702622:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2545cbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875724595199104:0@lo:400:kworker.0 00000100:00100000:2.0:1788830697.702851:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2545cbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3689682b-484d-410c-a8fd-1b98c0369c65:3307:1875724595198720:0@lo:400:kworker.0 00000100:00080000:2.0:1788830697.702883:0:14459:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788830697.702894:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e2545cbdc00 x1875724595199360/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788830713 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788830697.702905:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2545cbdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1875724595199360:0@lo:400:kworker.0 00010000:00080000:3.0:1788830697.702917:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e2545cbd880 x1875724595199232/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788830713 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788830697.702924:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2545cbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875724595199232:0@lo:400:kworker.0 00000004:00080000:3.0:1788830697.702944:0:14485:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788830697.703124:0:14485:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 451050413529ns, next at 0ns, rc = 0 00000004:00080000:3.0:1788830697.703171:0:14488:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x5:0x0] 00000100:00100000:3.0:1788830697.703190:0:14488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2545cbdc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14488:1875724595199616:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1788830697.703209:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2545cbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875724595199488:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788830697.704824:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830697.704974:0:15147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595199488 00000100:00100000:1.0:1788830697.704988:0:15147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595199488 00000100:00100000:1.0:1788830697.705086:0:15147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788830697.705096:0:15147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25658c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1875724595199488:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788830697.705130:0:15147:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788830697.705184:0:15147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25658c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1875724595199488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830697.705191:0:15147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000004:00080000:0.0:1788830697.706694:0:14486:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x6:0x0] 00000100:00100000:0.0:1788830697.706749:0:14486:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25478b7800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14486:1875724595199872:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1788830697.706796:0:14486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830697.706819:0:14486:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2553736d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788830697.708526:0:14488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830697.708562:0:14488:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2553723cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788830697.708602:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25478b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875724595199744:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788830697.708664:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830697.708733:0:15147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595199744 00000100:00100000:3.0:1788830697.708742:0:15147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595199744 00000100:00100000:0.0:1788830697.709452:0:15145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595199872 00000100:00100000:0.0:1788830697.709460:0:15145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595199872 00000100:00100000:0.0:1788830697.709504:0:15145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595199616 00000100:00100000:0.0:1788830697.709508:0:15145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595199616 00000100:00100000:0.0:1788830697.709523:0:15145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788830697.709530:0:15145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25478b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:14486:x1875724595199872:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1788830697.713270:0:15147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788830697.713287:0:15147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2545cbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1875724595199744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788830697.713323:0:15147:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788830697.713417:0:15147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2545cbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1875724595199744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 136us (4752us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830697.713425:0:15147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788830697.713482:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e25478b6300 x1875724595199744/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788830713 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788830697.713507:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25478b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875724595199744:0@lo:13:osp-pre-0-0.0 00002000:00080000:0.0:1788830697.714010:0:15145:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:0.0:1788830697.714018:0:15145:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:0.0:1788830697.714024:0:15145:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:7 to 0x240000400:33) 00010000:00080000:3.0:1788830697.715409:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e2545cbd880 x1875724595199488/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788830713 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788830697.715433:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2545cbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875724595199488:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1788830697.718144:0:14459:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788830697.718152:0:14459:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:0.0:1788830697.722353:0:15145:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788830697.722374:0:15145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007ecfb759/0x575506951eea1d09 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830697.722391:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=451s v=(0 0) 00010000:00010000:0.0:1788830697.722396:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788830697.722402:0:15145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007ecfb759/0x575506951eea1d09 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830697.722431:0:15145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007ecfb759/0x575506951eea1d09 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830697.722441:0:15145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007ecfb759/0x575506951eea1d09 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830697.722448:0:15145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007ecfb759/0x575506951eea1d09 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830697.722469:0:15145:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788830697.723220:0:15145:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788830697.723227:0:15145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c3a59a05/0x575506951eea1d10 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830697.723237:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=451s v=(0 0) 00010000:00010000:0.0:1788830697.723240:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788830697.723244:0:15145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c3a59a05/0x575506951eea1d10 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830697.723253:0:15145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c3a59a05/0x575506951eea1d10 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830697.723260:0:15145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c3a59a05/0x575506951eea1d10 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830697.723279:0:15145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c3a59a05/0x575506951eea1d10 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830697.723295:0:15145:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788830697.723307:0:14451:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788830697.723313:0:14451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007ecfb759/0x575506951eea1d09 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830697.723320:0:14451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e25658d7e00 already unused, calling callback (ffffffffc14cb350) 00010000:00010000:0.0:1788830697.723325:0:14451:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007ecfb759/0x575506951eea1d09 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830697.723333:0:14451:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007ecfb759/0x575506951eea1d09 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830697.723351:0:14451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007ecfb759/0x575506951eea1d09 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830697.723358:0:14451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007ecfb759/0x575506951eea1d09 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830697.724310:0:14452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788830697.726847:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788830697.726850:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788830697.726852:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788830697.727458:0:15145:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788830697.727474:0:15145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008899ea0c/0x575506951eea1d17 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830697.727490:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=451s v=(0 0) 00010000:00010000:0.0:1788830697.727495:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788830697.727502:0:15145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008899ea0c/0x575506951eea1d17 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830697.727517:0:15145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008899ea0c/0x575506951eea1d17 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830697.727528:0:15145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008899ea0c/0x575506951eea1d17 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830697.727536:0:15145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008899ea0c/0x575506951eea1d17 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830697.727554:0:15145:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788830697.727968:0:15145:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788830697.727974:0:15145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a3545b26/0x575506951eea1d1e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830697.727982:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=451s v=(0 0) 00010000:00010000:0.0:1788830697.727986:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788830697.727990:0:15145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a3545b26/0x575506951eea1d1e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830697.728000:0:15145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a3545b26/0x575506951eea1d1e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830697.728014:0:15145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a3545b26/0x575506951eea1d1e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830697.728021:0:15145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a3545b26/0x575506951eea1d1e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830697.728030:0:15145:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1788830697.728415:0:15145:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788830697.728421:0:15145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eb30c2ef/0x575506951eea1d25 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830697.728429:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=451s v=(0 0) 00010000:00010000:0.0:1788830697.728432:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788830697.728436:0:15145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eb30c2ef/0x575506951eea1d25 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830697.728445:0:15145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eb30c2ef/0x575506951eea1d25 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830697.728452:0:15145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eb30c2ef/0x575506951eea1d25 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830697.728460:0:15145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eb30c2ef/0x575506951eea1d25 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830697.728476:0:15145:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1788830697.728885:0:15145:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788830697.728891:0:15145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a1d1040/0x575506951eea1d2c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830697.728899:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=451s v=(0 0) 00010000:00010000:0.0:1788830697.728901:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788830697.728905:0:15145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006a1d1040/0x575506951eea1d2c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830697.728914:0:15145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006a1d1040/0x575506951eea1d2c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830697.728922:0:15145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a1d1040/0x575506951eea1d2c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830697.728928:0:15145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006a1d1040/0x575506951eea1d2c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830697.728936:0:15145:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:0.0:1788830697.729287:0:15145:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788830697.729293:0:15145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b388f7fe/0x575506951eea1d33 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830697.729300:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=451s v=(0 0) 00010000:00010000:0.0:1788830697.729307:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788830697.729311:0:15145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b388f7fe/0x575506951eea1d33 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830697.729320:0:15145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b388f7fe/0x575506951eea1d33 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830697.729327:0:15145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b388f7fe/0x575506951eea1d33 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830697.729333:0:15145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b388f7fe/0x575506951eea1d33 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830697.729340:0:15145:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:0.0:1788830697.729696:0:15145:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788830697.729702:0:15145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d95df5e5/0x575506951eea1d3a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830697.729737:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=451s v=(0 0) 00010000:00010000:0.0:1788830697.729740:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788830697.729744:0:15145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d95df5e5/0x575506951eea1d3a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830697.729753:0:15145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d95df5e5/0x575506951eea1d3a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830697.729762:0:15145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d95df5e5/0x575506951eea1d3a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830697.729775:0:15145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d95df5e5/0x575506951eea1d3a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830697.729784:0:15145:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:0.0:1788830697.730206:0:15145:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788830697.730211:0:15145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000058dc573e/0x575506951eea1d41 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830697.730220:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=451s v=(0 0) 00010000:00010000:0.0:1788830697.730222:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788830697.730226:0:15145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000058dc573e/0x575506951eea1d41 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830697.730235:0:15145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000058dc573e/0x575506951eea1d41 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830697.730242:0:15145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000058dc573e/0x575506951eea1d41 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830697.730249:0:15145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000058dc573e/0x575506951eea1d41 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830697.730255:0:15145:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00010000:00010000:2.0:1788830697.730761:0:14451:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1788830697.730769:0:14451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008899ea0c/0x575506951eea1d17 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830697.730777:0:14451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e25658d7a00 already unused, calling callback (ffffffffc14cb350) 00010000:00010000:2.0:1788830697.730781:0:14451:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008899ea0c/0x575506951eea1d17 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830697.730790:0:14451:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008899ea0c/0x575506951eea1d17 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830697.730810:0:14451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008899ea0c/0x575506951eea1d17 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830697.730828:0:14451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008899ea0c/0x575506951eea1d17 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830697.730847:0:14451:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1788830697.730850:0:14451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a3545b26/0x575506951eea1d1e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830697.730856:0:14451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e25658d7800 already unused, calling callback (ffffffffc14cb350) 00010000:00010000:2.0:1788830697.730858:0:14451:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a3545b26/0x575506951eea1d1e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830697.730866:0:14451:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a3545b26/0x575506951eea1d1e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830697.730875:0:14451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a3545b26/0x575506951eea1d1e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830697.730881:0:14451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a3545b26/0x575506951eea1d1e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830697.730891:0:14451:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1788830697.730894:0:14451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eb30c2ef/0x575506951eea1d25 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830697.730900:0:14451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e25658d7000 already unused, calling callback (ffffffffc14cb350) 00010000:00010000:2.0:1788830697.730908:0:14451:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eb30c2ef/0x575506951eea1d25 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830697.730916:0:14451:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eb30c2ef/0x575506951eea1d25 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830697.730926:0:14451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eb30c2ef/0x575506951eea1d25 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830697.730933:0:14451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eb30c2ef/0x575506951eea1d25 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830697.730946:0:14451:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788830697.730950:0:14451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006a1d1040/0x575506951eea1d2c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830697.730956:0:14451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e25658d6400 already unused, calling callback (ffffffffc14cb350) 00010000:00010000:2.0:1788830697.730959:0:14451:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006a1d1040/0x575506951eea1d2c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830697.730967:0:14451:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006a1d1040/0x575506951eea1d2c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830697.730976:0:14451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006a1d1040/0x575506951eea1d2c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830697.730982:0:14451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006a1d1040/0x575506951eea1d2c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830697.730999:0:14451:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788830697.731002:0:14451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b388f7fe/0x575506951eea1d33 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830697.731008:0:14451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e25658d7600 already unused, calling callback (ffffffffc14cb350) 00010000:00010000:2.0:1788830697.731011:0:14451:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b388f7fe/0x575506951eea1d33 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830697.731017:0:14451:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b388f7fe/0x575506951eea1d33 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830697.731027:0:14451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b388f7fe/0x575506951eea1d33 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830697.731033:0:14451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b388f7fe/0x575506951eea1d33 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830697.731044:0:14451:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788830697.731046:0:14451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d95df5e5/0x575506951eea1d3a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830697.731052:0:14451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e25658d6000 already unused, calling callback (ffffffffc14cb350) 00010000:00010000:2.0:1788830697.731054:0:14451:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d95df5e5/0x575506951eea1d3a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830697.731071:0:14451:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d95df5e5/0x575506951eea1d3a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830697.731080:0:14451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d95df5e5/0x575506951eea1d3a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830697.731087:0:14451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d95df5e5/0x575506951eea1d3a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830697.731099:0:14451:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788830697.731102:0:14451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000058dc573e/0x575506951eea1d41 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830697.731109:0:14451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e25658d7200 already unused, calling callback (ffffffffc14cb350) 00010000:00010000:2.0:1788830697.731112:0:14451:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000058dc573e/0x575506951eea1d41 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830697.731120:0:14451:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000058dc573e/0x575506951eea1d41 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830697.731128:0:14451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000058dc573e/0x575506951eea1d41 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830697.731134:0:14451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000058dc573e/0x575506951eea1d41 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830697.731156:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788830697.731158:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788830697.731160:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788830697.733724:0:15935:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788830697.733729:0:15935:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788830697.733732:0:15935:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788830697.734036:0:14452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c3a59a05/0x575506951eea1d10 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830697.734053:0:14452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e25658d6800 already unused, calling callback (ffffffffc14cb350) 00010000:00010000:3.0:1788830697.734057:0:14452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3a59a05/0x575506951eea1d10 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830697.734068:0:14452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3a59a05/0x575506951eea1d10 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830697.734095:0:14452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c3a59a05/0x575506951eea1d10 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830697.734103:0:14452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c3a59a05/0x575506951eea1d10 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830697.734121:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788830697.734124:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788830697.734125:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788830697.739428:0:15145:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788830697.739441:0:15145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f49ebc25/0x575506951eea1d48 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830697.739463:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=451s v=(0 0) 00010000:00010000:0.0:1788830697.739467:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788830697.739473:0:15145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f49ebc25/0x575506951eea1d48 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830697.739486:0:15145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f49ebc25/0x575506951eea1d48 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830697.739497:0:15145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f49ebc25/0x575506951eea1d48 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830697.739505:0:15145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f49ebc25/0x575506951eea1d48 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830697.739570:0:15145:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788830697.739619:0:14451:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788830697.739627:0:14451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f49ebc25/0x575506951eea1d48 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830697.739635:0:14451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e25658d7c00 already unused, calling callback (ffffffffc14cb350) 00010000:00010000:2.0:1788830697.739640:0:14451:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f49ebc25/0x575506951eea1d48 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830697.739649:0:14451:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f49ebc25/0x575506951eea1d48 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830697.739665:0:14451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f49ebc25/0x575506951eea1d48 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830697.739672:0:14451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f49ebc25/0x575506951eea1d48 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830697.739690:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788830697.739692:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788830697.739693:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788830697.740038:0:15145:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788830697.740044:0:15145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6226e66/0x575506951eea1d4f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830697.740053:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=451s v=(0 0) 00010000:00010000:0.0:1788830697.740056:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788830697.740060:0:15145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6226e66/0x575506951eea1d4f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830697.740070:0:15145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6226e66/0x575506951eea1d4f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830697.740088:0:15145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6226e66/0x575506951eea1d4f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830697.740094:0:15145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a6226e66/0x575506951eea1d4f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830697.740117:0:15145:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788830697.740419:0:15935:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788830697.740425:0:15935:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a6226e66/0x575506951eea1d4f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830697.740433:0:15935:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e25658d6200 already unused, calling callback (ffffffffc14cb350) 00010000:00010000:2.0:1788830697.740436:0:15935:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6226e66/0x575506951eea1d4f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830697.740445:0:15935:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6226e66/0x575506951eea1d4f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830697.740456:0:15935:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a6226e66/0x575506951eea1d4f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830697.740463:0:15935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6226e66/0x575506951eea1d4f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830697.740489:0:15935:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788830697.740491:0:15935:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788830697.740492:0:15145:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788830697.740493:0:15935:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788830697.740497:0:15145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c22f2043/0x575506951eea1d56 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830697.740505:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=451s v=(0 0) 00010000:00010000:0.0:1788830697.740509:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788830697.740512:0:15145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c22f2043/0x575506951eea1d56 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830697.740521:0:15145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c22f2043/0x575506951eea1d56 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830697.740528:0:15145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c22f2043/0x575506951eea1d56 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830697.740536:0:15145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c22f2043/0x575506951eea1d56 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830697.740564:0:15145:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788830697.740844:0:14452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788830697.740851:0:14452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c22f2043/0x575506951eea1d56 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830697.740858:0:14452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e25658d6a00 already unused, calling callback (ffffffffc14cb350) 00010000:00010000:3.0:1788830697.740862:0:14452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c22f2043/0x575506951eea1d56 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830697.740869:0:14452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c22f2043/0x575506951eea1d56 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830697.740880:0:14452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c22f2043/0x575506951eea1d56 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830697.740887:0:14452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c22f2043/0x575506951eea1d56 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830697.740910:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788830697.740912:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788830697.740914:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788830697.743651:0:15145:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788830697.743664:0:15145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f554937a/0x575506951eea1d5d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830697.743680:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=451s v=(0 0) 00010000:00010000:1.0:1788830697.743685:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788830697.743691:0:15145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f554937a/0x575506951eea1d5d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830697.743732:0:15145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f554937a/0x575506951eea1d5d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830697.743745:0:15145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f554937a/0x575506951eea1d5d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830697.743753:0:15145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f554937a/0x575506951eea1d5d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830697.743775:0:15145:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788830697.743821:0:14451:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788830697.743828:0:14451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f554937a/0x575506951eea1d5d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830697.743838:0:14451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e257fa8d600 already unused, calling callback (ffffffffc14cb350) 00010000:00010000:2.0:1788830697.743842:0:14451:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f554937a/0x575506951eea1d5d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830697.743863:0:14451:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f554937a/0x575506951eea1d5d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830697.743879:0:14451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f554937a/0x575506951eea1d5d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830697.743887:0:14451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f554937a/0x575506951eea1d5d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830697.743903:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788830697.743904:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788830697.743906:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788830697.744380:0:15145:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788830697.744392:0:15145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d5ca2b34/0x575506951eea1d64 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830697.744401:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=451s v=(0 0) 00010000:00010000:1.0:1788830697.744404:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788830697.744408:0:15145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d5ca2b34/0x575506951eea1d64 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830697.744419:0:15145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d5ca2b34/0x575506951eea1d64 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830697.744428:0:15145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d5ca2b34/0x575506951eea1d64 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830697.744435:0:15145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d5ca2b34/0x575506951eea1d64 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830697.744456:0:15145:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788830697.744496:0:15935:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788830697.744502:0:15935:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d5ca2b34/0x575506951eea1d64 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830697.744510:0:15935:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e257fa8de00 already unused, calling callback (ffffffffc14cb350) 00010000:00010000:2.0:1788830697.744514:0:15935:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d5ca2b34/0x575506951eea1d64 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830697.744523:0:15935:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d5ca2b34/0x575506951eea1d64 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830697.744547:0:15935:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d5ca2b34/0x575506951eea1d64 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830697.744566:0:15935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d5ca2b34/0x575506951eea1d64 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830697.744580:0:15935:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788830697.744582:0:15935:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788830697.744584:0:15935:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788830697.745425:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00010000:1.0:1788830697.745691:0:15145:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788830697.745698:0:15145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000904ccdce/0x575506951eea1d6b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830697.745991:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=451s v=(0 0) 00010000:00010000:1.0:1788830697.745996:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788830697.746002:0:15145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000904ccdce/0x575506951eea1d6b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830697.746014:0:15145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000904ccdce/0x575506951eea1d6b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830697.746031:0:15145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000904ccdce/0x575506951eea1d6b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830697.746038:0:15145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000904ccdce/0x575506951eea1d6b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830697.746054:0:15145:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788830697.746064:0:14452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788830697.746069:0:14452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000904ccdce/0x575506951eea1d6b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830697.746076:0:14452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e257fa8c600 already unused, calling callback (ffffffffc14cb350) 00010000:00010000:1.0:1788830697.746080:0:14452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000904ccdce/0x575506951eea1d6b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830697.746089:0:14452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000904ccdce/0x575506951eea1d6b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830697.746101:0:14452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000904ccdce/0x575506951eea1d6b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830697.746107:0:14452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000904ccdce/0x575506951eea1d6b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830697.746121:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788830697.746127:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788830697.746129:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788830697.747698:0:15145:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788830697.747812:0:15145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bd0a3fec/0x575506951eea1d72 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830697.747827:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=451s v=(0 0) 00010000:00010000:1.0:1788830697.747832:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788830697.747837:0:15145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bd0a3fec/0x575506951eea1d72 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830697.747848:0:15145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bd0a3fec/0x575506951eea1d72 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830697.747857:0:15145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bd0a3fec/0x575506951eea1d72 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830697.747864:0:15145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bd0a3fec/0x575506951eea1d72 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830697.747919:0:15145:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788830697.748829:0:15145:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788830697.748837:0:15145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002df69f84/0x575506951eea1d79 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830697.748849:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=451s v=(0 0) 00010000:00010000:1.0:1788830697.748852:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788830697.748857:0:15145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002df69f84/0x575506951eea1d79 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830697.748873:0:15145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002df69f84/0x575506951eea1d79 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830697.748882:0:15145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002df69f84/0x575506951eea1d79 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830697.748888:0:15145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002df69f84/0x575506951eea1d79 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830697.750321:0:14451:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788830697.750334:0:14451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bd0a3fec/0x575506951eea1d72 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830697.750346:0:14451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e257fa8c400 already unused, calling callback (ffffffffc14cb350) 00010000:00010000:0.0:1788830697.750351:0:14451:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd0a3fec/0x575506951eea1d72 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830697.750370:0:14451:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd0a3fec/0x575506951eea1d72 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830697.750390:0:14451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bd0a3fec/0x575506951eea1d72 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830697.750397:0:14451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bd0a3fec/0x575506951eea1d72 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830697.750454:0:14451:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788830697.750459:0:14451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002df69f84/0x575506951eea1d79 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830697.750466:0:14451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e257fa8d000 already unused, calling callback (ffffffffc14cb350) 00010000:00010000:0.0:1788830697.750470:0:14451:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002df69f84/0x575506951eea1d79 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830697.750484:0:14451:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002df69f84/0x575506951eea1d79 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830697.750494:0:14451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002df69f84/0x575506951eea1d79 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830697.750581:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788830697.750584:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788830697.750586:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788830697.750685:0:15145:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788830697.750691:0:15145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002df69f84/0x575506951eea1d79 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830697.750786:0:15935:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788830697.752661:0:15145:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788830697.752671:0:15145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012bf0d1d/0x575506951eea1d80 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830697.752685:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=451s v=(0 0) 00010000:00010000:1.0:1788830697.752689:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788830697.752696:0:15145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012bf0d1d/0x575506951eea1d80 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830697.752776:0:15145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012bf0d1d/0x575506951eea1d80 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830697.755128:0:15145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012bf0d1d/0x575506951eea1d80 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830697.755138:0:15145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000012bf0d1d/0x575506951eea1d80 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830697.755166:0:15145:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788830697.755210:0:14452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788830697.755220:0:14452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000012bf0d1d/0x575506951eea1d80 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830697.755229:0:14452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e257fa8d400 already unused, calling callback (ffffffffc14cb350) 00010000:00010000:2.0:1788830697.755235:0:14452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000012bf0d1d/0x575506951eea1d80 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830697.755244:0:14452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000012bf0d1d/0x575506951eea1d80 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830697.755268:0:14452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000012bf0d1d/0x575506951eea1d80 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830697.755274:0:14452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012bf0d1d/0x575506951eea1d80 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830697.755325:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788830697.755328:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788830697.755339:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788830697.756006:0:15145:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788830697.756013:0:15145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a27a8661/0x575506951eea1d87 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830697.756025:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=451s v=(0 0) 00010000:00010000:1.0:1788830697.756030:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788830697.756035:0:15145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a27a8661/0x575506951eea1d87 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830697.756047:0:15145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a27a8661/0x575506951eea1d87 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830697.756055:0:15145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a27a8661/0x575506951eea1d87 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830697.756061:0:15145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a27a8661/0x575506951eea1d87 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830697.756096:0:15145:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788830697.757180:0:15145:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788830697.757188:0:15145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad414220/0x575506951eea1d8e lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830697.757202:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=451s v=(0 0) 00010000:00010000:1.0:1788830697.757206:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788830697.757211:0:15145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ad414220/0x575506951eea1d8e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830697.757222:0:15145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ad414220/0x575506951eea1d8e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830697.757231:0:15145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad414220/0x575506951eea1d8e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830697.757238:0:15145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ad414220/0x575506951eea1d8e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830697.757260:0:15145:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788830697.757403:0:15935:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788830697.757411:0:15935:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a27a8661/0x575506951eea1d87 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830697.757420:0:15935:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e257fa8d800 already unused, calling callback (ffffffffc14cb350) 00010000:00010000:2.0:1788830697.757424:0:15935:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a27a8661/0x575506951eea1d87 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830697.757434:0:15935:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a27a8661/0x575506951eea1d87 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830697.757451:0:15935:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a27a8661/0x575506951eea1d87 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830697.757459:0:15935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a27a8661/0x575506951eea1d87 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830697.757476:0:15935:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788830697.757479:0:15935:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ad414220/0x575506951eea1d8e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830697.757485:0:15935:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e257fa8c800 already unused, calling callback (ffffffffc14cb350) 00010000:00010000:2.0:1788830697.757488:0:15935:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad414220/0x575506951eea1d8e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830697.757496:0:15935:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad414220/0x575506951eea1d8e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830697.757512:0:15935:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ad414220/0x575506951eea1d8e lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830697.757518:0:15935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ad414220/0x575506951eea1d8e lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830697.757529:0:15935:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788830697.757531:0:15935:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788830697.757613:0:15935:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788830697.757687:0:15145:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788830697.757693:0:15145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000075f37922/0x575506951eea1d95 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830697.757702:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=451s v=(0 0) 00010000:00010000:1.0:1788830697.757767:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788830697.757772:0:15145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000075f37922/0x575506951eea1d95 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830697.757781:0:15145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000075f37922/0x575506951eea1d95 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830697.757789:0:15145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000075f37922/0x575506951eea1d95 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830697.757796:0:15145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000075f37922/0x575506951eea1d95 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830697.757845:0:15145:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788830697.757848:0:14452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788830697.757852:0:14452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000075f37922/0x575506951eea1d95 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830697.757859:0:14452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e25820ffc00 already unused, calling callback (ffffffffc14cb350) 00010000:00010000:2.0:1788830697.757863:0:14452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000075f37922/0x575506951eea1d95 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830697.757871:0:14452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000075f37922/0x575506951eea1d95 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830697.757883:0:14452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000075f37922/0x575506951eea1d95 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830697.757890:0:14452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000075f37922/0x575506951eea1d95 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830697.757913:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788830697.757914:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788830697.757916:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788830697.758220:0:15145:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788830697.758226:0:15145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000054ddf2b2/0x575506951eea1d9c lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830697.758234:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=451s v=(0 0) 00010000:00010000:1.0:1788830697.758237:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788830697.758240:0:15145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054ddf2b2/0x575506951eea1d9c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830697.758248:0:15145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054ddf2b2/0x575506951eea1d9c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830697.758255:0:15145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000054ddf2b2/0x575506951eea1d9c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830697.758266:0:15145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000054ddf2b2/0x575506951eea1d9c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830697.758281:0:15145:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788830697.758291:0:15935:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788830697.758294:0:15935:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000054ddf2b2/0x575506951eea1d9c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830697.758300:0:15935:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e25820fe600 already unused, calling callback (ffffffffc14cb350) 00010000:00010000:1.0:1788830697.758304:0:15935:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000054ddf2b2/0x575506951eea1d9c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830697.758311:0:15935:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000054ddf2b2/0x575506951eea1d9c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830697.758322:0:15935:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000054ddf2b2/0x575506951eea1d9c lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830697.758329:0:15935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054ddf2b2/0x575506951eea1d9c lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830697.758342:0:15935:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788830697.758343:0:15935:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788830697.758345:0:15935:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788830697.758749:0:15145:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788830697.758762:0:15145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001bb67583/0x575506951eea1da3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830697.758770:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=451s v=(0 0) 00010000:00010000:1.0:1788830697.758774:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788830697.758778:0:15145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001bb67583/0x575506951eea1da3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830697.758788:0:15145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001bb67583/0x575506951eea1da3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830697.758797:0:15145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001bb67583/0x575506951eea1da3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830697.758804:0:15145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001bb67583/0x575506951eea1da3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830697.758824:0:15145:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788830697.758830:0:14452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788830697.758835:0:14452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001bb67583/0x575506951eea1da3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830697.758843:0:14452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e25820fea00 already unused, calling callback (ffffffffc14cb350) 00010000:00010000:2.0:1788830697.758847:0:14452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001bb67583/0x575506951eea1da3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830697.758855:0:14452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001bb67583/0x575506951eea1da3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830697.758867:0:14452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001bb67583/0x575506951eea1da3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830697.758875:0:14452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001bb67583/0x575506951eea1da3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830697.758888:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788830697.758890:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788830697.758891:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788830697.759196:0:15145:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788830697.759202:0:15145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028011214/0x575506951eea1daa lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830697.759211:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=451s v=(0 0) 00010000:00010000:1.0:1788830697.759214:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788830697.759218:0:15145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000028011214/0x575506951eea1daa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830697.759227:0:15145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000028011214/0x575506951eea1daa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830697.759240:0:15145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028011214/0x575506951eea1daa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830697.759248:0:15145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000028011214/0x575506951eea1daa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830697.759261:0:15145:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788830697.759270:0:15935:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788830697.759274:0:15935:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000028011214/0x575506951eea1daa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830697.759281:0:15935:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e25820fe200 already unused, calling callback (ffffffffc14cb350) 00010000:00010000:1.0:1788830697.759284:0:15935:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000028011214/0x575506951eea1daa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830697.759292:0:15935:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000028011214/0x575506951eea1daa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830697.759303:0:15935:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000028011214/0x575506951eea1daa lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830697.759310:0:15935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000028011214/0x575506951eea1daa lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830697.759323:0:15935:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788830697.759330:0:15935:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788830697.759332:0:15935:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788830697.759733:0:15145:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788830697.759739:0:15145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000438e04c7/0x575506951eea1db1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830697.759749:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=451s v=(0 0) 00010000:00010000:1.0:1788830697.759752:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788830697.759756:0:15145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000438e04c7/0x575506951eea1db1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830697.759765:0:15145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000438e04c7/0x575506951eea1db1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830697.759774:0:15145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000438e04c7/0x575506951eea1db1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830697.759782:0:15145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000438e04c7/0x575506951eea1db1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830697.759801:0:15145:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788830697.759808:0:14452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788830697.759813:0:14452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000438e04c7/0x575506951eea1db1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830697.759830:0:14452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e25820fee00 already unused, calling callback (ffffffffc14cb350) 00010000:00010000:2.0:1788830697.759834:0:14452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000438e04c7/0x575506951eea1db1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830697.759842:0:14452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000438e04c7/0x575506951eea1db1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830697.759854:0:14452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000438e04c7/0x575506951eea1db1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830697.759861:0:14452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000438e04c7/0x575506951eea1db1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830697.759874:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788830697.759876:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788830697.759877:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788830697.760168:0:15145:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788830697.760174:0:15145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005cd528ab/0x575506951eea1db8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830697.760183:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=451s v=(0 0) 00010000:00010000:1.0:1788830697.760186:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788830697.760190:0:15145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cd528ab/0x575506951eea1db8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830697.760204:0:15145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cd528ab/0x575506951eea1db8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830697.760212:0:15145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005cd528ab/0x575506951eea1db8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830697.760220:0:15145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005cd528ab/0x575506951eea1db8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830697.760233:0:15145:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788830697.760240:0:15935:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788830697.760244:0:15935:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005cd528ab/0x575506951eea1db8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830697.760251:0:15935:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e25820ffe00 already unused, calling callback (ffffffffc14cb350) 00010000:00010000:1.0:1788830697.760255:0:15935:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005cd528ab/0x575506951eea1db8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830697.760263:0:15935:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005cd528ab/0x575506951eea1db8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830697.760273:0:15935:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005cd528ab/0x575506951eea1db8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830697.760281:0:15935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cd528ab/0x575506951eea1db8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830697.760299:0:15935:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788830697.760300:0:15935:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788830697.760302:0:15935:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788830697.760489:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788830697.765273:0:15145:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788830697.765287:0:15145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab0a9838/0x575506951eea1dbf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830697.765304:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=451s v=(0 0) 00010000:00010000:1.0:1788830697.765309:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788830697.765315:0:15145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab0a9838/0x575506951eea1dbf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830697.765330:0:15145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab0a9838/0x575506951eea1dbf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830697.765340:0:15145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab0a9838/0x575506951eea1dbf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830697.765347:0:15145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ab0a9838/0x575506951eea1dbf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830697.765950:0:14452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788830697.765951:0:15145:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788830697.765958:0:14452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ab0a9838/0x575506951eea1dbf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830697.765967:0:14452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e25820fe400 already unused, calling callback (ffffffffc14cb350) 00010000:00010000:2.0:1788830697.765971:0:14452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab0a9838/0x575506951eea1dbf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830697.765980:0:14452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab0a9838/0x575506951eea1dbf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830697.766004:0:14452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ab0a9838/0x575506951eea1dbf lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830697.766012:0:14452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab0a9838/0x575506951eea1dbf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830697.766032:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788830697.766035:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788830697.766037:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1788830697.766191:0:15145:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:6 00000100:00100000:1.0:1788830697.766279:0:15145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25478b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14486:x1875724595199872:12345-0@lo:5:osp-pre-0-0.0 Request processed in 56746us (59479us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830697.766291:0:15145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788830697.766328:0:15145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788830697.766341:0:15145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2545cbea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14488:x1875724595199616:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1788830697.766450:0:14486:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25478b7800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14486:1875724595199872:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1788830697.766465:0:14486:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x6:0x0] 00000100:00100000:2.0:1788830697.766512:0:14486:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25658c3800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14486:1875724595200000:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1788830697.766627:0:14486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788830697.766672:0:14486:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2547fe8780 going to sleep for 11 seconds 00000100:00100000:2.0:1788830697.766689:0:15146:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1788830697.766696:0:15146:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1788830697.770465:0:15146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595200000 00000100:00100000:1.0:1788830697.770477:0:15146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595200000 00000100:00100000:0.0:1788830697.770609:0:15939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788830697.770620:0:15939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25658c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:14486:x1875724595200000:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1788830697.770665:0:15939:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000100:00100000:1.0:1788830697.786807:0:15939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25658c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:14486:x1875724595200000:12345-0@lo:5:osp-pre-0-0.0 Request processed in 16181us (20172us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1788830697.786823:0:15939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788830697.788648:0:14486:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25658c3800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14486:1875724595200000:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1788830697.788674:0:14486:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00002000:00080000:3.0:1788830697.788940:0:15145:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1788830697.788955:0:15145:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:3.0:1788830697.788963:0:15145:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:6 to 0x280000400:33) 00002000:00010000:3.0:1788830697.800639:0:15145:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788830697.800653:0:15145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000020a124de/0x575506951eea1dc6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830697.800669:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=451s v=(0 0) 00010000:00010000:3.0:1788830697.800673:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788830697.800679:0:15145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000020a124de/0x575506951eea1dc6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830697.800697:0:15145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000020a124de/0x575506951eea1dc6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788830697.800992:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00010000:3.0:1788830697.801076:0:15145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000020a124de/0x575506951eea1dc6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830697.801086:0:15145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000020a124de/0x575506951eea1dc6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830697.801138:0:15145:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788830697.801691:0:15145:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788830697.801698:0:15145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ab0bf965/0x575506951eea1dcd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830697.801725:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=451s v=(0 0) 00010000:00010000:3.0:1788830697.801729:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788830697.801734:0:15145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ab0bf965/0x575506951eea1dcd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830697.801744:0:15145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ab0bf965/0x575506951eea1dcd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830697.801751:0:15145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ab0bf965/0x575506951eea1dcd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830697.801758:0:15145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ab0bf965/0x575506951eea1dcd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830697.801968:0:15935:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788830697.801975:0:15935:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000020a124de/0x575506951eea1dc6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830697.801982:0:15935:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e257d944200 already unused, calling callback (ffffffffc14cb350) 00010000:00010000:0.0:1788830697.801986:0:15935:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000020a124de/0x575506951eea1dc6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830697.801994:0:15935:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000020a124de/0x575506951eea1dc6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830697.802020:0:15935:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000020a124de/0x575506951eea1dc6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830697.802026:0:15935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000020a124de/0x575506951eea1dc6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830697.802048:0:15935:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788830697.802051:0:15935:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ab0bf965/0x575506951eea1dcd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830697.802056:0:15935:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e257d944000 already unused, calling callback (ffffffffc14cb350) 00010000:00010000:0.0:1788830697.802059:0:15935:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ab0bf965/0x575506951eea1dcd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830697.802065:0:15935:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ab0bf965/0x575506951eea1dcd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830697.802073:0:15935:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ab0bf965/0x575506951eea1dcd lrc: 2/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830697.802079:0:15935:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788830697.802081:0:15935:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788830697.802083:0:15935:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788830697.802511:0:15145:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788830697.802517:0:15145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ab0bf965/0x575506951eea1dcd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788830697.803040:0:15145:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788830697.803047:0:15145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005adfe4de/0x575506951eea1dd4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830697.803057:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=451s v=(0 0) 00010000:00010000:3.0:1788830697.803067:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788830697.803072:0:15145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005adfe4de/0x575506951eea1dd4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830697.803083:0:15145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005adfe4de/0x575506951eea1dd4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830697.803092:0:15145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005adfe4de/0x575506951eea1dd4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830697.803100:0:15145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005adfe4de/0x575506951eea1dd4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830697.803456:0:14451:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788830697.803462:0:14451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005adfe4de/0x575506951eea1dd4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830697.803482:0:14451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e257d945c00 already unused, calling callback (ffffffffc14cb350) 00010000:00010000:0.0:1788830697.803485:0:14451:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005adfe4de/0x575506951eea1dd4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830697.803494:0:14451:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005adfe4de/0x575506951eea1dd4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830697.803507:0:14451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005adfe4de/0x575506951eea1dd4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830697.803516:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788830697.803518:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788830697.803520:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788830697.803883:0:15145:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788830697.803889:0:15145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005adfe4de/0x575506951eea1dd4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788830697.804462:0:15145:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788830697.804469:0:15145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000073305c70/0x575506951eea1ddb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830697.804480:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=451s v=(0 0) 00010000:00010000:3.0:1788830697.804484:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788830697.804489:0:15145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000073305c70/0x575506951eea1ddb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830697.804500:0:15145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000073305c70/0x575506951eea1ddb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830697.804515:0:15145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000073305c70/0x575506951eea1ddb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830697.804522:0:15145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000073305c70/0x575506951eea1ddb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830697.804589:0:14452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788830697.804596:0:14452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000073305c70/0x575506951eea1ddb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830697.804603:0:14452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e257d944800 already unused, calling callback (ffffffffc14cb350) 00010000:00010000:0.0:1788830697.804607:0:14452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000073305c70/0x575506951eea1ddb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830697.804616:0:14452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000073305c70/0x575506951eea1ddb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830697.804629:0:14452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000073305c70/0x575506951eea1ddb lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830697.804644:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788830697.804645:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788830697.804648:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788830697.804798:0:15145:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788830697.804803:0:15145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000073305c70/0x575506951eea1ddb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788830697.805212:0:15145:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788830697.805218:0:15145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008f1b9454/0x575506951eea1de2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830697.805227:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=451s v=(0 0) 00010000:00010000:3.0:1788830697.805231:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788830697.807750:0:15145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008f1b9454/0x575506951eea1de2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830697.807785:0:15145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008f1b9454/0x575506951eea1de2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830697.807798:0:15145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008f1b9454/0x575506951eea1de2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830697.807829:0:15145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008f1b9454/0x575506951eea1de2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830697.807921:0:15935:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788830697.807930:0:15935:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008f1b9454/0x575506951eea1de2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830697.807940:0:15935:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e257d944a00 already unused, calling callback (ffffffffc14cb350) 00010000:00010000:0.0:1788830697.807945:0:15935:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008f1b9454/0x575506951eea1de2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830697.807956:0:15935:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008f1b9454/0x575506951eea1de2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830697.807976:0:15935:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008f1b9454/0x575506951eea1de2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830697.807988:0:15935:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788830697.807990:0:15935:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788830697.807992:0:15935:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788830697.808075:0:15145:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788830697.808081:0:15145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008f1b9454/0x575506951eea1de2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788830697.809358:0:15145:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788830697.809377:0:15145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fa387a6c/0x575506951eea1de9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830697.809392:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=451s v=(0 0) 00010000:00010000:3.0:1788830697.809397:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788830697.809403:0:15145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fa387a6c/0x575506951eea1de9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830697.809414:0:15145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fa387a6c/0x575506951eea1de9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830697.809423:0:15145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fa387a6c/0x575506951eea1de9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830697.809430:0:15145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fa387a6c/0x575506951eea1de9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830697.809667:0:14451:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788830697.809675:0:14451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fa387a6c/0x575506951eea1de9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830697.809683:0:14451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e257d945800 already unused, calling callback (ffffffffc14cb350) 00010000:00010000:0.0:1788830697.809687:0:14451:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fa387a6c/0x575506951eea1de9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830697.809701:0:14451:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fa387a6c/0x575506951eea1de9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830697.809775:0:14451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fa387a6c/0x575506951eea1de9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830697.809861:0:15145:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788830697.809867:0:15145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fa387a6c/0x575506951eea1de9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830697.810327:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788830697.810530:0:15145:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788830697.810537:0:15145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4d69407/0x575506951eea1df0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830697.810548:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=451s v=(0 0) 00010000:00010000:3.0:1788830697.810551:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788830697.810556:0:15145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4d69407/0x575506951eea1df0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830697.810567:0:15145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b4d69407/0x575506951eea1df0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830697.810577:0:15145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4d69407/0x575506951eea1df0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830697.810584:0:15145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b4d69407/0x575506951eea1df0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830697.810607:0:15145:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788830697.811435:0:15935:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788830697.811442:0:15935:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b4d69407/0x575506951eea1df0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830697.811452:0:15935:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e257d945400 already unused, calling callback (ffffffffc14cb350) 00010000:00010000:0.0:1788830697.811456:0:15935:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4d69407/0x575506951eea1df0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830697.811466:0:15935:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4d69407/0x575506951eea1df0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830697.811495:0:15935:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b4d69407/0x575506951eea1df0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830697.811503:0:15935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b4d69407/0x575506951eea1df0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830697.811524:0:15935:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788830697.811531:0:15935:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788830697.811533:0:15935:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788830697.812033:0:15145:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788830697.812042:0:15145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d2fc459b/0x575506951eea1df7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830697.812056:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=451s v=(0 0) 00010000:00010000:3.0:1788830697.812060:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788830697.812066:0:15145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d2fc459b/0x575506951eea1df7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830697.812076:0:15145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d2fc459b/0x575506951eea1df7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830697.812085:0:15145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d2fc459b/0x575506951eea1df7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830697.812093:0:15145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d2fc459b/0x575506951eea1df7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830697.812108:0:15145:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788830697.812668:0:15145:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788830697.812675:0:15145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000358a1257/0x575506951eea1dfe lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830697.812683:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=451s v=(0 0) 00010000:00010000:3.0:1788830697.812686:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788830697.812690:0:15145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000358a1257/0x575506951eea1dfe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830697.812699:0:15145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000358a1257/0x575506951eea1dfe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830697.812743:0:15145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000358a1257/0x575506951eea1dfe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830697.812749:0:15145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000358a1257/0x575506951eea1dfe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830697.812762:0:15145:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1788830697.813138:0:15145:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788830697.813144:0:15145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004fc63e7b/0x575506951eea1e05 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830697.813153:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=451s v=(0 0) 00010000:00010000:3.0:1788830697.813156:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788830697.813160:0:15145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004fc63e7b/0x575506951eea1e05 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830697.813169:0:15145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004fc63e7b/0x575506951eea1e05 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830697.813176:0:15145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004fc63e7b/0x575506951eea1e05 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830697.813183:0:15145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004fc63e7b/0x575506951eea1e05 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830697.813202:0:15145:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1788830697.813349:0:14451:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788830697.813357:0:14451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d2fc459b/0x575506951eea1df7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830697.813377:0:14451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e257d80e400 already unused, calling callback (ffffffffc14cb350) 00010000:00010000:1.0:1788830697.813381:0:14451:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d2fc459b/0x575506951eea1df7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830697.813391:0:14451:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d2fc459b/0x575506951eea1df7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830697.813408:0:14451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d2fc459b/0x575506951eea1df7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830697.813415:0:14451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d2fc459b/0x575506951eea1df7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830697.813436:0:14451:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788830697.813439:0:14451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000358a1257/0x575506951eea1dfe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830697.813457:0:14451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e257d80f200 already unused, calling callback (ffffffffc14cb350) 00010000:00010000:1.0:1788830697.813460:0:14451:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000358a1257/0x575506951eea1dfe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830697.813468:0:14451:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000358a1257/0x575506951eea1dfe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788830697.813925:0:15145:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788830697.813931:0:15145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000efbb9604/0x575506951eea1e0c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830697.813939:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=451s v=(0 0) 00010000:00010000:3.0:1788830697.813942:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788830697.813946:0:15145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000efbb9604/0x575506951eea1e0c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830697.813955:0:15145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000efbb9604/0x575506951eea1e0c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830697.813962:0:15145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000efbb9604/0x575506951eea1e0c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830697.813969:0:15145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000efbb9604/0x575506951eea1e0c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830697.813977:0:15145:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788830697.814349:0:14451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000358a1257/0x575506951eea1dfe lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830697.814357:0:14451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000358a1257/0x575506951eea1dfe lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830697.814387:0:14451:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788830697.814391:0:14451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004fc63e7b/0x575506951eea1e05 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830697.814398:0:14451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e257d80fc00 already unused, calling callback (ffffffffc14cb350) 00010000:00010000:1.0:1788830697.814401:0:14451:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004fc63e7b/0x575506951eea1e05 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830697.814409:0:14451:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004fc63e7b/0x575506951eea1e05 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830697.814418:0:14451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004fc63e7b/0x575506951eea1e05 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830697.814432:0:14451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004fc63e7b/0x575506951eea1e05 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830697.814443:0:14451:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788830697.814447:0:14451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000efbb9604/0x575506951eea1e0c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830697.814453:0:14451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e257d80e200 already unused, calling callback (ffffffffc14cb350) 00010000:00010000:1.0:1788830697.814457:0:14451:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000efbb9604/0x575506951eea1e0c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830697.814464:0:14451:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000efbb9604/0x575506951eea1e0c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830697.814524:0:14451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000efbb9604/0x575506951eea1e0c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830697.814533:0:14451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000efbb9604/0x575506951eea1e0c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830697.814548:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788830697.814550:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788830697.814551:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788830697.814634:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788830697.814640:0:15935:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788830697.814905:0:15145:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788830697.814913:0:15145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005f611a07/0x575506951eea1e13 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830697.814922:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=451s v=(0 0) 00010000:00010000:3.0:1788830697.814931:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788830697.814936:0:15145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005f611a07/0x575506951eea1e13 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830697.814946:0:15145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005f611a07/0x575506951eea1e13 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830697.814956:0:15145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005f611a07/0x575506951eea1e13 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830697.814963:0:15145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005f611a07/0x575506951eea1e13 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830697.815029:0:15145:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788830697.815467:0:15145:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788830697.815588:0:15145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c9fe41fa/0x575506951eea1e1a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830697.815599:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=451s v=(0 0) 00010000:00010000:3.0:1788830697.815603:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788830697.815607:0:15145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c9fe41fa/0x575506951eea1e1a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830697.815617:0:15145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c9fe41fa/0x575506951eea1e1a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830697.815626:0:15145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c9fe41fa/0x575506951eea1e1a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830697.815641:0:15145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c9fe41fa/0x575506951eea1e1a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830697.815671:0:14451:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788830697.815677:0:14451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005f611a07/0x575506951eea1e13 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830697.815692:0:14451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e257d80e600 already unused, calling callback (ffffffffc14cb350) 00010000:00010000:1.0:1788830697.815695:0:14451:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005f611a07/0x575506951eea1e13 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830697.815703:0:14451:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005f611a07/0x575506951eea1e13 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830697.815748:0:14451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005f611a07/0x575506951eea1e13 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830697.815755:0:14451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005f611a07/0x575506951eea1e13 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830697.815772:0:14451:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788830697.815775:0:14451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c9fe41fa/0x575506951eea1e1a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830697.815781:0:14451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e257d80e800 already unused, calling callback (ffffffffc14cb350) 00010000:00010000:1.0:1788830697.815784:0:14451:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c9fe41fa/0x575506951eea1e1a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830697.815790:0:14451:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c9fe41fa/0x575506951eea1e1a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830697.815799:0:14451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c9fe41fa/0x575506951eea1e1a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830697.815812:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788830697.815813:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788830697.815816:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788830697.815923:0:15145:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788830697.815929:0:15145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c9fe41fa/0x575506951eea1e1a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788830697.816374:0:15145:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788830697.816380:0:15145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003bb09657/0x575506951eea1e21 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830697.816390:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=451s v=(0 0) 00010000:00010000:3.0:1788830697.816393:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788830697.816397:0:15145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003bb09657/0x575506951eea1e21 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830697.816406:0:15145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003bb09657/0x575506951eea1e21 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830697.816414:0:15145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003bb09657/0x575506951eea1e21 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830697.816421:0:15145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003bb09657/0x575506951eea1e21 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830697.817789:0:14452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788830697.817800:0:14452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003bb09657/0x575506951eea1e21 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830697.817813:0:14452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e257d80fe00 already unused, calling callback (ffffffffc14cb350) 00010000:00010000:0.0:1788830697.817817:0:14452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003bb09657/0x575506951eea1e21 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830697.817827:0:14452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003bb09657/0x575506951eea1e21 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830697.817844:0:14452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003bb09657/0x575506951eea1e21 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830697.817856:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788830697.817858:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788830697.817859:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788830697.821989:0:15145:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788830697.822002:0:15145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003bb09657/0x575506951eea1e21 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830697.822046:0:15935:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788830697.823201:0:15145:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788830697.823212:0:15145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c236447/0x575506951eea1e28 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830697.823230:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=451s v=(0 0) 00010000:00010000:3.0:1788830697.823234:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788830697.823241:0:15145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008c236447/0x575506951eea1e28 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830697.823255:0:15145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008c236447/0x575506951eea1e28 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830697.823265:0:15145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c236447/0x575506951eea1e28 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830697.823272:0:15145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008c236447/0x575506951eea1e28 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830697.823287:0:15145:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788830697.823403:0:14451:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788830697.823411:0:14451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008c236447/0x575506951eea1e28 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830697.823419:0:14451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2445f8f800 already unused, calling callback (ffffffffc14cb350) 00010000:00010000:1.0:1788830697.823425:0:14451:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008c236447/0x575506951eea1e28 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830697.823435:0:14451:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008c236447/0x575506951eea1e28 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830697.823452:0:14451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008c236447/0x575506951eea1e28 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830697.823459:0:14451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008c236447/0x575506951eea1e28 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830697.823477:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788830697.823479:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788830697.823481:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788830697.828221:0:15145:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788830697.828241:0:15145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000081c7dc11/0x575506951eea1e2f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830697.828261:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=451s v=(0 0) 00010000:00010000:3.0:1788830697.828266:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788830697.828273:0:15145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000081c7dc11/0x575506951eea1e2f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830697.828287:0:15145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000081c7dc11/0x575506951eea1e2f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830697.828299:0:15145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000081c7dc11/0x575506951eea1e2f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830697.828307:0:15145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000081c7dc11/0x575506951eea1e2f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830697.828349:0:15145:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788830697.828395:0:14452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788830697.828403:0:14452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000081c7dc11/0x575506951eea1e2f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830697.828411:0:14452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2445f8e000 already unused, calling callback (ffffffffc14cb350) 00010000:00010000:2.0:1788830697.828415:0:14452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000081c7dc11/0x575506951eea1e2f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830697.828424:0:14452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000081c7dc11/0x575506951eea1e2f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830697.828448:0:14452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000081c7dc11/0x575506951eea1e2f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830697.828455:0:14452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000081c7dc11/0x575506951eea1e2f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830697.828473:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788830697.828475:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788830697.828477:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788830697.832906:0:15145:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788830697.832917:0:15145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c70bd9d/0x575506951eea1e36 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830697.832934:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=451s v=(0 0) 00010000:00010000:3.0:1788830697.832939:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788830697.832945:0:15145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c70bd9d/0x575506951eea1e36 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830697.832959:0:15145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002c70bd9d/0x575506951eea1e36 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830697.832976:0:15145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c70bd9d/0x575506951eea1e36 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830697.832983:0:15145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002c70bd9d/0x575506951eea1e36 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830697.833011:0:15145:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788830697.833397:0:15935:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788830697.833404:0:15935:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002c70bd9d/0x575506951eea1e36 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788830697.833408:0:15145:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788830697.833414:0:15145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d02fdbea/0x575506951eea1e3d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830697.833414:0:15935:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2445f8ea00 already unused, calling callback (ffffffffc14cb350) 00010000:00010000:0.0:1788830697.833418:0:15935:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002c70bd9d/0x575506951eea1e36 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830697.833422:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=451s v=(0 0) 00010000:00010000:3.0:1788830697.833425:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788830697.833429:0:15145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d02fdbea/0x575506951eea1e3d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830697.833439:0:15145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d02fdbea/0x575506951eea1e3d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830697.833439:0:15935:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002c70bd9d/0x575506951eea1e36 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830697.833448:0:15145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d02fdbea/0x575506951eea1e3d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830697.833454:0:15145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d02fdbea/0x575506951eea1e3d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830697.833456:0:15935:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002c70bd9d/0x575506951eea1e36 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830697.833464:0:15935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002c70bd9d/0x575506951eea1e36 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830697.833480:0:15935:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788830697.833484:0:15935:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d02fdbea/0x575506951eea1e3d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830697.833487:0:15145:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788830697.833491:0:15935:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2445f8f200 already unused, calling callback (ffffffffc14cb350) 00010000:00010000:0.0:1788830697.833494:0:15935:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d02fdbea/0x575506951eea1e3d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830697.833501:0:15935:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d02fdbea/0x575506951eea1e3d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830697.833511:0:15935:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d02fdbea/0x575506951eea1e3d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830697.833518:0:15935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d02fdbea/0x575506951eea1e3d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830697.833539:0:15935:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788830697.833540:0:15935:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788830697.833542:0:15935:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788830697.833585:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788830697.833953:0:15145:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788830697.833960:0:15145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000db58a04b/0x575506951eea1e44 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830697.833970:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=451s v=(0 0) 00010000:00010000:2.0:1788830697.833973:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788830697.833977:0:15145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000db58a04b/0x575506951eea1e44 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830697.833986:0:15145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000db58a04b/0x575506951eea1e44 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830697.833994:0:15145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000db58a04b/0x575506951eea1e44 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830697.834000:0:15145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000db58a04b/0x575506951eea1e44 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830697.834026:0:15145:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788830697.834395:0:15145:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788830697.834401:0:15145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c7dc25c5/0x575506951eea1e4b lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830697.834411:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=451s v=(0 0) 00010000:00010000:2.0:1788830697.834414:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788830697.834418:0:15145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c7dc25c5/0x575506951eea1e4b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830697.834427:0:15145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c7dc25c5/0x575506951eea1e4b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830697.834435:0:15145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c7dc25c5/0x575506951eea1e4b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830697.834442:0:15145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c7dc25c5/0x575506951eea1e4b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830697.834466:0:15145:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788830697.834636:0:15935:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788830697.834642:0:15935:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000db58a04b/0x575506951eea1e44 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830697.834651:0:15935:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2565729e00 already unused, calling callback (ffffffffc14cb350) 00010000:00010000:3.0:1788830697.834655:0:15935:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000db58a04b/0x575506951eea1e44 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830697.834663:0:15935:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000db58a04b/0x575506951eea1e44 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830697.834676:0:15935:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000db58a04b/0x575506951eea1e44 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830697.834683:0:15935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000db58a04b/0x575506951eea1e44 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830697.834697:0:15935:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788830697.834700:0:15935:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c7dc25c5/0x575506951eea1e4b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830697.834705:0:15935:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2565729800 already unused, calling callback (ffffffffc14cb350) 00010000:00010000:0.0:1788830697.834773:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788830697.835204:0:15935:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c7dc25c5/0x575506951eea1e4b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830697.835227:0:15935:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c7dc25c5/0x575506951eea1e4b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830697.835240:0:15935:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c7dc25c5/0x575506951eea1e4b lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830697.835248:0:15935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c7dc25c5/0x575506951eea1e4b lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830697.835261:0:15935:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788830697.835262:0:15935:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788830697.835264:0:15935:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788830697.835695:0:15145:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788830697.835702:0:15145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009f4303fc/0x575506951eea1e52 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830697.835876:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=451s v=(0 0) 00010000:00010000:2.0:1788830697.835884:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788830697.835890:0:15145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009f4303fc/0x575506951eea1e52 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830697.835902:0:15145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009f4303fc/0x575506951eea1e52 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830697.835911:0:15145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009f4303fc/0x575506951eea1e52 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830697.835919:0:15145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009f4303fc/0x575506951eea1e52 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830697.835972:0:15145:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788830697.836348:0:15145:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788830697.836354:0:15145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c15da0ea/0x575506951eea1e59 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830697.836375:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=451s v=(0 0) 00010000:00010000:2.0:1788830697.836378:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788830697.836383:0:15145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c15da0ea/0x575506951eea1e59 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830697.836392:0:15145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c15da0ea/0x575506951eea1e59 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830697.836401:0:15145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c15da0ea/0x575506951eea1e59 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830697.836413:0:15145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c15da0ea/0x575506951eea1e59 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830697.837239:0:14451:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788830697.837249:0:14451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009f4303fc/0x575506951eea1e52 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830697.837260:0:14451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2565729000 already unused, calling callback (ffffffffc14cb350) 00010000:00010000:3.0:1788830697.837265:0:14451:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009f4303fc/0x575506951eea1e52 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830697.837274:0:14451:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009f4303fc/0x575506951eea1e52 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830697.837289:0:14451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009f4303fc/0x575506951eea1e52 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830697.837309:0:14451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009f4303fc/0x575506951eea1e52 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830697.837328:0:14451:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788830697.837332:0:14451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c15da0ea/0x575506951eea1e59 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830697.837338:0:14451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2565728000 already unused, calling callback (ffffffffc14cb350) 00010000:00010000:3.0:1788830697.837341:0:14451:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c15da0ea/0x575506951eea1e59 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830697.837349:0:14451:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c15da0ea/0x575506951eea1e59 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830697.837369:0:14451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c15da0ea/0x575506951eea1e59 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830697.837376:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788830697.837378:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788830697.837380:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788830697.837422:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788830697.837433:0:15145:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788830697.837439:0:15145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c15da0ea/0x575506951eea1e59 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788830697.838156:0:15145:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788830697.838163:0:15145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000006bb2e4a/0x575506951eea1e60 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830697.838175:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=451s v=(0 0) 00010000:00010000:2.0:1788830697.838179:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788830697.838184:0:15145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000006bb2e4a/0x575506951eea1e60 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830697.838196:0:15145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000006bb2e4a/0x575506951eea1e60 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830697.838204:0:15145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000006bb2e4a/0x575506951eea1e60 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830697.838212:0:15145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000006bb2e4a/0x575506951eea1e60 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830697.838274:0:15145:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788830697.838674:0:15935:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788830697.838681:0:15935:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000006bb2e4a/0x575506951eea1e60 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830697.838690:0:15935:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2565728a00 already unused, calling callback (ffffffffc14cb350) 00010000:00010000:3.0:1788830697.838699:0:15935:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000006bb2e4a/0x575506951eea1e60 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830697.838931:0:15935:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000006bb2e4a/0x575506951eea1e60 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830697.838947:0:15935:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000006bb2e4a/0x575506951eea1e60 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830697.838954:0:15935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000006bb2e4a/0x575506951eea1e60 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830697.839280:0:15935:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788830697.839282:0:15935:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788830697.839284:0:15935:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788830697.841167:0:15145:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788830697.841180:0:15145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e4ed4fbf/0x575506951eea1e67 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830697.841200:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=451s v=(0 0) 00010000:00010000:3.0:1788830697.841204:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788830697.841211:0:15145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e4ed4fbf/0x575506951eea1e67 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830697.841225:0:15145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e4ed4fbf/0x575506951eea1e67 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830697.841402:0:15145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e4ed4fbf/0x575506951eea1e67 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830697.841422:0:15145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e4ed4fbf/0x575506951eea1e67 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830697.841485:0:15145:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788830697.842019:0:15145:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788830697.842026:0:15145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008116829f/0x575506951eea1e6e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830697.842035:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=451s v=(0 0) 00010000:00010000:3.0:1788830697.842038:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788830697.842042:0:15145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008116829f/0x575506951eea1e6e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830697.842052:0:15145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008116829f/0x575506951eea1e6e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830697.842059:0:15145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008116829f/0x575506951eea1e6e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830697.842066:0:15145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008116829f/0x575506951eea1e6e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830697.842325:0:14451:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788830697.842333:0:14451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e4ed4fbf/0x575506951eea1e67 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830697.842342:0:14451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2445f8e600 already unused, calling callback (ffffffffc14cb350) 00010000:00010000:2.0:1788830697.842347:0:14451:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e4ed4fbf/0x575506951eea1e67 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830697.842356:0:14451:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e4ed4fbf/0x575506951eea1e67 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830697.842474:0:14451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e4ed4fbf/0x575506951eea1e67 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830697.842481:0:14451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e4ed4fbf/0x575506951eea1e67 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830697.842497:0:14451:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788830697.842500:0:14451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008116829f/0x575506951eea1e6e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830697.842507:0:14451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2445f8fc00 already unused, calling callback (ffffffffc14cb350) 00010000:00010000:2.0:1788830697.842516:0:14451:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008116829f/0x575506951eea1e6e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830697.842525:0:14451:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008116829f/0x575506951eea1e6e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830697.842593:0:14451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008116829f/0x575506951eea1e6e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830697.842602:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788830697.842603:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788830697.842606:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788830697.842955:0:15145:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788830697.842962:0:15145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008116829f/0x575506951eea1e6e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788830697.843452:0:15145:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788830697.843459:0:15145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d326039/0x575506951eea1e75 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830697.843470:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=451s v=(0 0) 00010000:00010000:3.0:1788830697.843473:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788830697.843478:0:15145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007d326039/0x575506951eea1e75 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830697.843488:0:15145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007d326039/0x575506951eea1e75 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830697.843497:0:15145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d326039/0x575506951eea1e75 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830697.843505:0:15145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007d326039/0x575506951eea1e75 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830697.843633:0:15145:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788830697.844085:0:15145:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788830697.844091:0:15145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b74dc48/0x575506951eea1e7c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830697.844100:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=451s v=(0 0) 00010000:00010000:3.0:1788830697.844103:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788830697.844112:0:15145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006b74dc48/0x575506951eea1e7c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830697.844121:0:15145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006b74dc48/0x575506951eea1e7c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830697.844129:0:15145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b74dc48/0x575506951eea1e7c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830697.844136:0:15145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006b74dc48/0x575506951eea1e7c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830697.844476:0:15935:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788830697.844484:0:15935:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007d326039/0x575506951eea1e75 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830697.844505:0:15935:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2445f8e200 already unused, calling callback (ffffffffc14cb350) 00010000:00010000:1.0:1788830697.844510:0:15935:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007d326039/0x575506951eea1e75 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830697.844519:0:15935:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007d326039/0x575506951eea1e75 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830697.844692:0:15935:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007d326039/0x575506951eea1e75 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830697.844701:0:15935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007d326039/0x575506951eea1e75 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830697.844750:0:15935:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788830697.844754:0:15935:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006b74dc48/0x575506951eea1e7c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830697.844761:0:15935:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2445f8fe00 already unused, calling callback (ffffffffc14cb350) 00010000:00010000:1.0:1788830697.844764:0:15935:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006b74dc48/0x575506951eea1e7c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830697.844772:0:15935:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006b74dc48/0x575506951eea1e7c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830697.844783:0:15935:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006b74dc48/0x575506951eea1e7c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830697.844797:0:15935:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788830697.844799:0:15935:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788830697.844801:0:15935:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788830697.844912:0:15145:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788830697.844918:0:15145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006b74dc48/0x575506951eea1e7c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788830697.845385:0:15145:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788830697.845390:0:15145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c70ad5d0/0x575506951eea1e83 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830697.845400:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=451s v=(0 0) 00010000:00010000:3.0:1788830697.845404:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788830697.845409:0:15145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c70ad5d0/0x575506951eea1e83 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830697.845419:0:15145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c70ad5d0/0x575506951eea1e83 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830697.845435:0:15145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c70ad5d0/0x575506951eea1e83 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830697.845442:0:15145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c70ad5d0/0x575506951eea1e83 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830697.845462:0:15145:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:3.0:1788830697.845804:0:15145:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:5 00000100:00100000:3.0:1788830697.845901:0:15145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2545cbea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14488:x1875724595199616:12345-0@lo:5:osp-pre-1-0.0 Request processed in 79560us (137376us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830697.845915:0:15145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788830697.845969:0:14488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2545cbdc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14488:1875724595199616:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1788830697.845984:0:14488:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x5:0x0] 00000100:00100000:3.0:1788830697.846027:0:14488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2545cbdc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14488:1875724595200128:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1788830697.846060:0:14488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830697.846100:0:14488:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2553723cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788830697.846115:0:15145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595200128 00000100:00100000:3.0:1788830697.846121:0:15145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595200128 00000100:00100000:3.0:1788830697.846155:0:15145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788830697.846163:0:15145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2545cbd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14488:x1875724595200128:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1788830697.846198:0:15145:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00010000:00010000:0.0:1788830697.846347:0:14451:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788830697.846355:0:14451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c70ad5d0/0x575506951eea1e83 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830697.846375:0:14451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2445f8e400 already unused, calling callback (ffffffffc14cb350) 00010000:00010000:0.0:1788830697.846380:0:14451:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c70ad5d0/0x575506951eea1e83 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830697.846389:0:14451:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c70ad5d0/0x575506951eea1e83 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830697.846404:0:14451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c70ad5d0/0x575506951eea1e83 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830697.846411:0:14451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c70ad5d0/0x575506951eea1e83 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830697.846431:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788830697.846433:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788830697.846434:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788830697.847383:0:15935:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788830697.848379:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788830697.852205:0:15145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2545cbd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:14488:x1875724595200128:12345-0@lo:5:osp-pre-1-0.0 Request processed in 6035us (6137us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1788830697.852219:0:15145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788830697.852389:0:14488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2545cbdc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14488:1875724595200128:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1788830697.852405:0:14488:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 10000000:01000000:3.0:1788830698.140806:0:14460:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788830698.140813:0:14460:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9e25460f8000 from 8 10000000:01000000:3.0:1788830698.140819:0:14460:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788830698.140862:0:14460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.121@tcp lock: ffff9e2445f8fe00/0x575506951eea1e8a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830698.140874:0:14460:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.121@tcp lock: ffff9e2445f8fe00/0x575506951eea1e8a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830698.140886:0:14460:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.121@tcp lock: ffff9e2445f8fe00/0x575506951eea1e8a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788830698.140913:0:14460:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2545cbc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3689682b-484d-410c-a8fd-1b98c0369c65:14460:1875724595200256:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788830698.140977:0:14460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830698.141033:0:14460:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e25480646c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788830698.141232:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595200256 00000100:00100000:2.0:1788830698.141241:0:14455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595200256 00000100:00100000:2.0:1788830698.141292:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788830698.141302:0:14455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2444872050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3689682b-484d-410c-a8fd-1b98c0369c65+18:14460:x1875724595200256:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788830698.141316:0:14455:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788830698.141331:0:14455:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2565728000/0x575506951eea1e91 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x575506951eea1e8a expref: -99 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830698.141364:0:14455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2565728000/0x575506951eea1e91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x575506951eea1e8a expref: 19 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830698.141375:0:14455:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2565728000/0x575506951eea1e91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x575506951eea1e8a expref: 19 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830698.141398:0:14455:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2565728000, rc 0) 00000100:00100000:2.0:1788830698.141442:0:14455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2444872050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3689682b-484d-410c-a8fd-1b98c0369c65+19:14460:x1875724595200256:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 142us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830698.141448:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788830698.141534:0:14460:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2545cbc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3689682b-484d-410c-a8fd-1b98c0369c65:14460:1875724595200256:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788830698.141550:0:14460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.121@tcp lock: ffff9e2445f8fe00/0x575506951eea1e8a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea1e91 expref: -99 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830698.141558:0:14460:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.121@tcp lock: ffff9e2445f8fe00/0x575506951eea1e8a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x575506951eea1e91 expref: -99 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788830698.141604:0:14460:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2545cbc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3689682b-484d-410c-a8fd-1b98c0369c65:14460:1875724595200384:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788830698.141636:0:14460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830698.141664:0:14460:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e25480646c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788830698.142031:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595200384 00000100:00100000:2.0:1788830698.142036:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595200384 00000100:00100000:2.0:1788830698.142068:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788830698.142073:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e254737fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3689682b-484d-410c-a8fd-1b98c0369c65+19:14460:x1875724595200384:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788830698.142086:0:14458:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788830698.142103:0:14458:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788830698.142200:0:14458:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:2.0:1788830698.142299:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e254737fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3689682b-484d-410c-a8fd-1b98c0369c65+19:14460:x1875724595200384:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 225us (662us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830698.142307:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788830698.142384:0:14460:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2545cbc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3689682b-484d-410c-a8fd-1b98c0369c65:14460:1875724595200384:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788830698.142443:0:14460:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.121@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788830698.142449:0:14460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: ffff9e2445f8fe00/0x575506951eea1e8a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea1e91 expref: -99 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830698.142462:0:14460:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.121@tcp lock: ffff9e2445f8fe00/0x575506951eea1e8a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea1e91 expref: -99 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830698.204127:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788830699.228832:0:15935:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788830700.252529:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788830700.357951:0:6709:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:0.0:1788830700.358000:0:6709:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1788830701.282057:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788830701.901169:0:7646:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:2.0:1788830701.901212:0:7646:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1788830702.311778:0:15935:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788830702.585050:0:16216:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg121-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1788830702.813467:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2545cbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3689682b-484d-410c-a8fd-1b98c0369c65:3309:1875724595200512:0@lo:400:kworker.0 00000100:00100000:3.0:1788830702.813596:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830702.813642:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25658e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875724595201024:0@lo:400:kworker.0 00000100:00100000:3.0:1788830702.813667:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830702.813691:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788830702.813697:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2545cbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875724595200640:0@lo:400:kworker.0 00000100:00100000:3.0:1788830702.813737:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830702.813754:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25658e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1875724595201152:0@lo:400:kworker.0 00000100:00100000:3.0:1788830702.813773:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830702.813801:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2545cbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875724595200768:0@lo:400:kworker.0 00000100:00100000:3.0:1788830702.813823:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830702.813839:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788830702.813843:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2545cbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875724595200896:0@lo:400:kworker.0 00000100:00100000:3.0:1788830702.813860:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830702.813886:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595200512 00000100:00100000:3.0:1788830702.813892:0:14455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595200512 00000100:00100000:3.0:1788830702.813930:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788830702.813938:0:14455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e254737e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3689682b-484d-410c-a8fd-1b98c0369c65+19:3309:x1875724595200512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788830702.813982:0:14455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e254737e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3689682b-484d-410c-a8fd-1b98c0369c65+19:3309:x1875724595200512:12345-0@lo:400:kworker.0 Request processed in 44us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830702.813988:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788830702.814030:0:14463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595201024 00000100:00100000:3.0:1788830702.814033:0:14463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595201024 00000100:00100000:3.0:1788830702.814059:0:14463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595201152 00000100:00100000:3.0:1788830702.814062:0:14463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595201152 00000100:00100000:3.0:1788830702.814071:0:14463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595200896 00000100:00100000:3.0:1788830702.814073:0:14463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595200896 00000100:00100000:3.0:1788830702.814082:0:14463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788830702.814087:0:14463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25658e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875724595201024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788830702.814114:0:14463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25658e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875724595201024:12345-0@lo:400:kworker.0 Request processed in 27us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830702.814119:0:14463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788830702.814128:0:14463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788830702.814132:0:14463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25658e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875724595201152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788830702.814150:0:14463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25658e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875724595201152:12345-0@lo:400:kworker.0 Request processed in 18us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830702.814154:0:14463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788830702.814162:0:14463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788830702.814166:0:14463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25658e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875724595200896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788830702.814187:0:14463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25658e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875724595200896:12345-0@lo:400:kworker.0 Request processed in 21us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830702.814192:0:14463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788830702.814209:0:15146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595200640 00000100:00100000:3.0:1788830702.814212:0:15146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595200640 00000100:00100000:3.0:1788830702.814231:0:15146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595200768 00000100:00100000:3.0:1788830702.814234:0:15146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595200768 00000100:00100000:3.0:1788830702.814251:0:15146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788830702.814257:0:15146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25658e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875724595200640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788830702.814301:0:15146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25658e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875724595200640:12345-0@lo:400:kworker.0 Request processed in 43us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830702.814312:0:15146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788830702.814325:0:15146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788830702.814330:0:15146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25658e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875724595200768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788830702.814357:0:15146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25658e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875724595200768:12345-0@lo:400:kworker.0 Request processed in 28us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830702.814363:0:15146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788830702.814399:0:3309:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1788830702.814416:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2545cbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875724595200640:0@lo:400:kworker.0 00010000:00080000:3.0:1788830702.814429:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e25658e3b80 x1875724595201152/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788830718 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788830702.814439:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25658e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1875724595201152:0@lo:400:kworker.0 00000100:00100000:3.0:1788830702.814447:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2545cbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3689682b-484d-410c-a8fd-1b98c0369c65:3309:1875724595200512:0@lo:400:kworker.0 00010000:00080000:3.0:1788830702.814455:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e25658e0000 x1875724595201024/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788830718 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788830702.814462:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25658e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875724595201024:0@lo:400:kworker.0 00000100:00080000:3.0:1788830702.814481:0:14459:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788830702.814485:0:14459:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788830702.814488:0:14459:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788830702.814502:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e2545cbfb80 x1875724595200896/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788830718 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788830702.814509:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2545cbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875724595200896:0@lo:400:kworker.0 00000100:00100000:3.0:1788830702.814516:0:3307:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1788830702.814525:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2545cbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875724595200768:0@lo:400:kworker.0 00000100:00100000:3.0:1788830702.816390:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25747c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875724595201280:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788830702.816452:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788830702.824465:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25658c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875724595201408:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788830702.824529:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788830702.824591:0:15148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595201280 00000100:00100000:2.0:1788830702.824597:0:15148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595201280 00000100:00100000:2.0:1788830702.824627:0:15148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595201408 00000100:00100000:2.0:1788830702.824629:0:15148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595201408 00000100:00100000:2.0:1788830702.824642:0:15148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788830702.824649:0:15148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25658e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875724595201280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788830702.824679:0:15148:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788830702.832640:0:15148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25658e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875724595201280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 7981us (16178us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830702.832656:0:15148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788830702.833161:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25747c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875724595201280:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788830702.833285:0:15148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788830702.833299:0:15148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25658c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875724595201408:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788830702.833335:0:15148:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788830702.833389:0:15148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25658c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875724595201408:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (8859us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830702.833395:0:15148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788830702.833427:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25658c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875724595201408:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788830703.325126:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788830704.351893:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788830704.576865:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830704.576967:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578430080 00000100:00100000:0.0:1788830704.576978:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578430080 00000100:00100000:0.0:1788830704.577039:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 75 00000100:00100000:0.0:1788830704.577048:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e254737dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2351:x1875724578430080:12345-192.168.201.21@tcp:250:mount.lustre.0 00010000:00080000:0.0:1788830704.577074:0:14457:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from fe7320b8-b931-453c-a880-19896cc1f024@192.168.201.21@tcp t0 exp 0000000000000000 cur 457 last 0 00000020:00000080:0.0:1788830704.577103:0:14457:0:(genops.c:1385:class_connect()) connect: client fe7320b8-b931-453c-a880-19896cc1f024, cookie 0x575506951eea1e98 00000100:00080000:0.0:1788830704.577240:0:14457:0:(import.c:65:import_set_state_nolock()) ffff9e244485b800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788830704.577321:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e254737dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fe7320b8-b931-453c-a880-19896cc1f024+5:2351:x1875724578430080:12345-192.168.201.21@tcp:250:mount.lustre.0 Request processed in 272us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830704.577329:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 75 00000100:00100000:3.0:1788830704.594387:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830704.594862:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578430208 00000100:00100000:2.0:1788830704.594872:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578430208 00000100:00100000:2.0:1788830704.594929:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 76 00000100:00100000:2.0:1788830704.594950:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e254737c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fe7320b8-b931-453c-a880-19896cc1f024+5:13751:x1875724578430208:12345-192.168.201.21@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788830704.594965:0:14458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788830704.594986:0:14458:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2565728a00/0x575506951eea1e9f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xa578910534662071 expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830704.595023:0:14458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2565728a00/0x575506951eea1e9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534662071 expref: 6 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830704.595035:0:14458:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2565728a00/0x575506951eea1e9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534662071 expref: 6 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830704.595043:0:14458:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2565728a00, rc 0) 00000100:00100000:2.0:1788830704.595122:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e254737c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fe7320b8-b931-453c-a880-19896cc1f024+6:13751:x1875724578430208:12345-192.168.201.21@tcp:101:mount.lustre.0 Request processed in 174us (744us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830704.595770:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 76 00000100:00100000:1.0:1788830704.599524:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830704.599588:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578430336 00000100:00100000:3.0:1788830704.599596:0:14455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578430336 00000100:00100000:3.0:1788830704.599640:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 77 00000100:00100000:3.0:1788830704.599647:0:14455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e254737d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fe7320b8-b931-453c-a880-19896cc1f024+6:13751:x1875724578430336:12345-192.168.201.21@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788830704.600004:0:14455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e254737d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fe7320b8-b931-453c-a880-19896cc1f024+6:13751:x1875724578430336:12345-192.168.201.21@tcp:501:mount.lustre.0 Request processed in 350us (480us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788830704.600011:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 77 00000100:00100000:1.0:1788830704.614766:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830704.614853:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578430464 00000100:00100000:0.0:1788830704.614863:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578430464 00000100:00100000:0.0:1788830704.614918:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 78 00000100:00100000:0.0:1788830704.614927:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e254737f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fe7320b8-b931-453c-a880-19896cc1f024+6:13751:x1875724578430464:12345-192.168.201.21@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788830704.614951:0:14457:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788830704.614967:0:14457:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e25658d7000/0x575506951eea1ea6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xa578910534662078 expref: -99 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830704.614993:0:14457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e25658d7000/0x575506951eea1ea6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534662078 expref: 7 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830704.615029:0:14457:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e25658d7000/0x575506951eea1ea6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534662078 expref: 7 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830704.615038:0:14457:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e25658d7000, rc 0) 00000100:00100000:0.0:1788830704.615089:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e254737f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fe7320b8-b931-453c-a880-19896cc1f024+7:13751:x1875724578430464:12345-192.168.201.21@tcp:101:mount.lustre.0 Request processed in 164us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830704.615096:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 78 00000100:00100000:0.0:1788830704.618605:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830704.618700:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578430592 00000100:00100000:2.0:1788830704.618746:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578430592 00000100:00100000:2.0:1788830704.618792:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 79 00000100:00100000:2.0:1788830704.618803:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e254737d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fe7320b8-b931-453c-a880-19896cc1f024+7:13751:x1875724578430592:12345-192.168.201.21@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788830704.619114:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e254737d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fe7320b8-b931-453c-a880-19896cc1f024+8:13751:x1875724578430592:12345-192.168.201.21@tcp:501:mount.lustre.0 Request processed in 312us (518us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830704.619131:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 79 00000100:00100000:1.0:1788830704.624702:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830704.624816:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578430720 00000100:00100000:3.0:1788830704.624826:0:14455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578430720 00000100:00100000:3.0:1788830704.624896:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 80 00000100:00100000:3.0:1788830704.624907:0:14455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e254737e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fe7320b8-b931-453c-a880-19896cc1f024+8:13751:x1875724578430720:12345-192.168.201.21@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788830704.625434:0:14455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e254737e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fe7320b8-b931-453c-a880-19896cc1f024+8:13751:x1875724578430720:12345-192.168.201.21@tcp:503:mount.lustre.0 Request processed in 528us (740us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830704.625443:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 80 00000100:00100000:1.0:1788830704.630504:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830704.630625:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578430848 00000100:00100000:0.0:1788830704.630636:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578430848 00000100:00100000:0.0:1788830704.630689:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 81 00000100:00100000:0.0:1788830704.630699:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e254737f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fe7320b8-b931-453c-a880-19896cc1f024+8:13770:x1875724578430848:12345-192.168.201.21@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788830704.631114:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e254737f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fe7320b8-b931-453c-a880-19896cc1f024+8:13770:x1875724578430848:12345-192.168.201.21@tcp:502:llog_process_th.0 Request processed in 415us (618us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830704.631124:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 81 00000100:00100000:0.0:1788830704.644700:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830704.645390:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578430976 00000100:00100000:2.0:1788830704.645400:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578430976 00000100:00100000:2.0:1788830704.645490:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 82 00000100:00100000:2.0:1788830704.645498:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e254737c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fe7320b8-b931-453c-a880-19896cc1f024+8:13770:x1875724578430976:12345-192.168.201.21@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788830704.645732:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e254737c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fe7320b8-b931-453c-a880-19896cc1f024+8:13770:x1875724578430976:12345-192.168.201.21@tcp:502:llog_process_th.0 Request processed in 234us (1040us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830704.645737:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 82 00000100:00100000:1.0:1788830704.650674:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830704.650803:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578431104 00000100:00100000:0.0:1788830704.650814:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578431104 00000100:00100000:0.0:1788830704.650876:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 83 00000100:00100000:0.0:1788830704.650886:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e254737d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fe7320b8-b931-453c-a880-19896cc1f024+8:13751:x1875724578431104:12345-192.168.201.21@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788830704.650901:0:14457:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788830704.650918:0:14457:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e25658d7600/0x575506951eea1ead lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa5789105346620a2 expref: -99 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830704.650946:0:14457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e25658d7600/0x575506951eea1ead lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.21@tcp remote: 0xa5789105346620a2 expref: 9 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830704.650966:0:14457:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e25658d7600/0x575506951eea1ead lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0xa5789105346620a2 expref: 9 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830704.650974:0:14457:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e25658d7600, rc 0) 00000100:00100000:0.0:1788830704.651052:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e254737d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fe7320b8-b931-453c-a880-19896cc1f024+9:13751:x1875724578431104:12345-192.168.201.21@tcp:101:mount.lustre.0 Request processed in 167us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830704.651059:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 83 00000100:00100000:1.0:1788830704.657545:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830704.657754:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578431232 00000100:00100000:2.0:1788830704.657764:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578431232 00000100:00100000:2.0:1788830704.657810:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 84 00000100:00100000:2.0:1788830704.657820:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e24451ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fe7320b8-b931-453c-a880-19896cc1f024+9:13751:x1875724578431232:12345-192.168.201.21@tcp:256:mount.lustre.0 20000000:01000000:2.0:1788830704.657843:0:14458:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788830704.657877:0:14458:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788830704.657882:0:14458:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788830704.657885:0:14458:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788830704.657887:0:14458:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:2.0:1788830704.667432:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e24451ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fe7320b8-b931-453c-a880-19896cc1f024+9:13751:x1875724578431232:12345-192.168.201.21@tcp:256:mount.lustre.0 Request processed in 9602us (9884us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830704.667448:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 84 00000040:00080000:0.0:1788830704.668811:0:14495:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788830704.675318:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830704.676186:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578431360 00000100:00100000:3.0:1788830704.676211:0:14455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578431360 00000100:00100000:3.0:1788830704.676317:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 85 00000100:00100000:3.0:1788830704.676331:0:14455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e24451c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fe7320b8-b931-453c-a880-19896cc1f024+9:13751:x1875724578431360:12345-192.168.201.21@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788830704.676353:0:14455:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788830704.676376:0:14455:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2445f8fa00/0x575506951eea1eb4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa5789105346620a9 expref: -99 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830704.676411:0:14455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2445f8fa00/0x575506951eea1eb4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.21@tcp remote: 0xa5789105346620a9 expref: 10 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830704.677542:0:14455:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2445f8fa00/0x575506951eea1eb4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0xa5789105346620a9 expref: 10 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830704.677555:0:14455:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2445f8fa00, rc 0) 00000100:00100000:3.0:1788830704.677646:0:14455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e24451c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fe7320b8-b931-453c-a880-19896cc1f024+10:13751:x1875724578431360:12345-192.168.201.21@tcp:101:mount.lustre.0 Request processed in 1318us (2340us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830704.677653:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 85 00000100:00100000:1.0:1788830704.681994:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830704.682305:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578431488 00000100:00100000:2.0:1788830704.682320:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578431488 00000100:00100000:2.0:1788830704.682445:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 86 00000100:00100000:2.0:1788830704.682458:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e24451cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fe7320b8-b931-453c-a880-19896cc1f024+10:13751:x1875724578431488:12345-192.168.201.21@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788830704.682854:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e24451cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fe7320b8-b931-453c-a880-19896cc1f024+10:13751:x1875724578431488:12345-192.168.201.21@tcp:501:mount.lustre.0 Request processed in 397us (875us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830704.682863:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 86 00000100:00100000:1.0:1788830704.688839:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830704.688954:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578431616 00000100:00100000:3.0:1788830704.688968:0:14455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578431616 00000100:00100000:3.0:1788830704.689044:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 87 00000100:00100000:3.0:1788830704.689057:0:14455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e24451c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fe7320b8-b931-453c-a880-19896cc1f024+10:13751:x1875724578431616:12345-192.168.201.21@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788830704.689675:0:14455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e24451c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fe7320b8-b931-453c-a880-19896cc1f024+10:13751:x1875724578431616:12345-192.168.201.21@tcp:503:mount.lustre.0 Request processed in 618us (850us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830704.689686:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 87 00000100:00100000:1.0:1788830704.705484:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830704.705588:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578431744 00000100:00100000:2.0:1788830704.705601:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578431744 00000100:00100000:2.0:1788830704.705672:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 88 00000100:00100000:2.0:1788830704.705684:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e24451ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fe7320b8-b931-453c-a880-19896cc1f024+10:13771:x1875724578431744:12345-192.168.201.21@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788830704.706101:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e24451ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fe7320b8-b931-453c-a880-19896cc1f024+10:13771:x1875724578431744:12345-192.168.201.21@tcp:502:llog_process_th.0 Request processed in 417us (630us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830704.706111:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 88 00000100:00100000:1.0:1788830704.711816:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830704.712395:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578431872 00000100:00100000:0.0:1788830704.712411:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578431872 00000100:00100000:0.0:1788830704.712498:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 89 00000100:00100000:0.0:1788830704.712511:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e24451c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fe7320b8-b931-453c-a880-19896cc1f024+10:13771:x1875724578431872:12345-192.168.201.21@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788830704.712886:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e24451c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fe7320b8-b931-453c-a880-19896cc1f024+10:13771:x1875724578431872:12345-192.168.201.21@tcp:502:llog_process_th.0 Request processed in 376us (1084us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830704.712896:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 89 00000100:00100000:3.0:1788830704.727304:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830704.727481:0:14463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578432000 00000100:00100000:0.0:1788830704.727496:0:14463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578432000 00000100:00100000:0.0:1788830704.727565:0:14463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 4 00000100:00100000:0.0:1788830704.727575:0:14463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25658e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2351:x1875724578432000:12345-192.168.201.21@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788830704.727615:0:14463:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 5d08645c-98b4-449f-9d92-4c318beec94d@192.168.201.21@tcp t0 exp 0000000000000000 cur 458 last 0 00000020:00000080:0.0:1788830704.727683:0:14463:0:(genops.c:1385:class_connect()) connect: client 5d08645c-98b4-449f-9d92-4c318beec94d, cookie 0x575506951eea1ebb 00000004:00100000:0.0:1788830704.727753:0:14463:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:0.0:1788830704.727760:0:14463:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:2.0:1788830704.817703:0:14463:0:(import.c:65:import_set_state_nolock()) ffff9e2566026800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788830704.817839:0:14463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25658e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d08645c-98b4-449f-9d92-4c318beec94d+6:2351:x1875724578432000:12345-192.168.201.21@tcp:38:mount.lustre.0 Request processed in 90262us (90548us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830704.817850:0:14463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 4 00000100:00100000:1.0:1788830704.825178:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830704.826948:0:14465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578432128 00000100:00100000:3.0:1788830704.826965:0:14465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578432128 00000100:00100000:3.0:1788830704.827057:0:14465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 5 00000100:00100000:3.0:1788830704.827069:0:14465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25747c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d08645c-98b4-449f-9d92-4c318beec94d+6:0:x1875724578432128:12345-192.168.201.21@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788830704.827113:0:14465:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788830704.827205:0:14465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25747c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d08645c-98b4-449f-9d92-4c318beec94d+6:0:x1875724578432128:12345-192.168.201.21@tcp:41:mount.lustre.0 Request processed in 138us (2042us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830704.827213:0:14465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 5 00000100:00100000:3.0:1788830704.827331:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830704.827403:0:14463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578432256 00000100:00100000:3.0:1788830704.827419:0:14463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578432256 00000100:00100000:3.0:1788830704.827656:0:14463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 6 00000100:00100000:3.0:1788830704.827670:0:14463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25658e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d08645c-98b4-449f-9d92-4c318beec94d+6:13751:x1875724578432256:12345-192.168.201.21@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788830704.827686:0:14463:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788830704.827755:0:14463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25658e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d08645c-98b4-449f-9d92-4c318beec94d+6:13751:x1875724578432256:12345-192.168.201.21@tcp:41:mount.lustre.0 Request processed in 90us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830704.827762:0:14463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 6 00000100:00080000:2.0:1788830704.829304:0:14459:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788830704.838087:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830704.839471:0:14463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578432384 00000100:00100000:3.0:1788830704.839493:0:14463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578432384 00000100:00100000:3.0:1788830704.839571:0:14463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 7 00000100:00100000:3.0:1788830704.839583:0:14463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25658c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d08645c-98b4-449f-9d92-4c318beec94d+6:13751:x1875724578432384:12345-192.168.201.21@tcp:40:mount.lustre.0 00000100:00100000:3.0:1788830704.839678:0:14463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25658c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d08645c-98b4-449f-9d92-4c318beec94d+6:13751:x1875724578432384:12345-192.168.201.21@tcp:40:mount.lustre.0 Request processed in 97us (1606us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830704.839687:0:14463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 7 00000100:00100000:0.0:1788830704.842580:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830704.842976:0:15146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578432512 00000100:00100000:3.0:1788830704.842993:0:15146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578432512 00000100:00100000:3.0:1788830704.843156:0:15146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 6 00000100:00100000:3.0:1788830704.843168:0:15146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25478b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2351:x1875724578432512:12345-192.168.201.21@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788830704.843216:0:15146:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 5d08645c-98b4-449f-9d92-4c318beec94d@192.168.201.21@tcp t0 exp 0000000000000000 cur 458 last 0 00000020:00000080:3.0:1788830704.843272:0:15146:0:(genops.c:1385:class_connect()) connect: client 5d08645c-98b4-449f-9d92-4c318beec94d, cookie 0x575506951eea1ec2 00002000:00100000:3.0:1788830704.843289:0:15146:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 5d08645c-98b4-449f-9d92-4c318beec94d/ffff9e2444ab7000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113968 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788830704.843319:0:15146:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788830704.843662:0:15146:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788830704.843697:0:15146:0:(import.c:65:import_set_state_nolock()) ffff9e2444ab6000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788830704.843825:0:15146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25478b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5d08645c-98b4-449f-9d92-4c318beec94d+6:2351:x1875724578432512:12345-192.168.201.21@tcp:8:mount.lustre.0 Request processed in 660us (1257us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830704.843846:0:15146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 6 00000100:00100000:0.0:1788830704.844182:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830704.844402:0:15146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578432640 00000100:00100000:0.0:1788830704.844414:0:15146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578432640 00000100:00100000:2.0:1788830704.844526:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830704.846004:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578432768 00000100:00100000:3.0:1788830704.846021:0:14466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578432768 00000100:00100000:3.0:1788830704.846096:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 0 00000100:00100000:3.0:1788830704.846108:0:14466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25658c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5d08645c-98b4-449f-9d92-4c318beec94d+6:13751:x1875724578432768:12345-192.168.201.21@tcp:33:mount.lustre.0 00000100:00100000:1.0:1788830704.846730:0:15939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 7 00000100:00100000:1.0:1788830704.846743:0:15939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25478b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2351:x1875724578432640:12345-192.168.201.21@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788830704.846780:0:15939:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 5d08645c-98b4-449f-9d92-4c318beec94d@192.168.201.21@tcp t0 exp 0000000000000000 cur 458 last 0 00000020:00000080:1.0:1788830704.846814:0:15939:0:(genops.c:1385:class_connect()) connect: client 5d08645c-98b4-449f-9d92-4c318beec94d, cookie 0x575506951eea1ec9 00002000:00100000:1.0:1788830704.846828:0:15939:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 5d08645c-98b4-449f-9d92-4c318beec94d/ffff9e2444aad800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113968 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788830704.846852:0:15939:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788830704.847368:0:15939:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788830704.847413:0:15939:0:(import.c:65:import_set_state_nolock()) ffff9e2444aaf800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788830704.848380:0:15939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25478b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5d08645c-98b4-449f-9d92-4c318beec94d+6:2351:x1875724578432640:12345-192.168.201.21@tcp:8:mount.lustre.0 Request processed in 1632us (4200us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830704.848392:0:15939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 7 00000004:00080000:3.0:1788830704.862022:0:14466:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 15831us 00000004:00200000:1.0:1788830704.876322:0:14466:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1788830704.876514:0:14466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25658c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5d08645c-98b4-449f-9d92-4c318beec94d+6:13751:x1875724578432768:12345-192.168.201.21@tcp:33:mount.lustre.0 Request processed in 30397us (31981us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830704.876563:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 0 00000100:00100000:2.0:1788830705.057137:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830705.059387:0:14464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578432896 00000100:00100000:1.0:1788830705.059409:0:14464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578432896 00000100:00100000:1.0:1788830705.059511:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 8 00000100:00100000:1.0:1788830705.059525:0:14464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25658c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d08645c-98b4-449f-9d92-4c318beec94d+6:13792:x1875724578432896:12345-192.168.201.21@tcp:101:mkdir.0 00010000:00010000:1.0:1788830705.059562:0:14464:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788830705.059684:0:14464:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff200/0x575506951eea1ed0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5789105346620d3 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830705.059828:0:14464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe800/0x575506951eea1ed7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830705.059843:0:14464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe800/0x575506951eea1ed7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830705.059856:0:14464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe800/0x575506951eea1ed7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788830705.059895:0:14464:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788830705.059898:0:14464:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788830705.059940:0:14464:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe800/0x575506951eea1ed7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830705.059994:0:14464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff200/0x575506951eea1ed0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0xa5789105346620d3 expref: 8 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830705.060013:0:14464:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe800/0x575506951eea1ed7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0xa5789105346620d3 expref: 7 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830705.060020:0:14464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e257480c100) 00010000:00010000:1.0:1788830705.060022:0:14464:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788830705.060025:0:14464:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e25820fe800, rc 0) 00000100:00100000:1.0:1788830705.060662:0:14464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25658c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d08645c-98b4-449f-9d92-4c318beec94d+7:13792:x1875724578432896:12345-192.168.201.21@tcp:101:mkdir.0 Request processed in 575us (2984us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830705.060670:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 8 00010000:00010000:2.0:1788830705.372346:0:15935:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788830705.423335:0:6709:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5d08645c-98b4-449f-9d92-4c318beec94d 00010000:00010000:2.0:1788830706.405611:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788830706.983567:0:7646:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 5d08645c-98b4-449f-9d92-4c318beec94d 00000100:00100000:0.0:1788830707.208826:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830707.209135:0:14465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578433024 00000100:00100000:3.0:1788830707.209145:0:14465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578433024 00000100:00100000:3.0:1788830707.209260:0:14465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 9 00000100:00100000:3.0:1788830707.209272:0:14465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25478b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d08645c-98b4-449f-9d92-4c318beec94d+7:13844:x1875724578433024:12345-192.168.201.21@tcp:41:lfs.0 00000004:00000024:3.0:1788830707.209317:0:14465:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788830707.209418:0:14465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25478b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d08645c-98b4-449f-9d92-4c318beec94d+7:13844:x1875724578433024:12345-192.168.201.21@tcp:41:lfs.0 Request processed in 147us (600us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830707.209425:0:14465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 9 00000100:00080000:2.0:1788830707.209752:0:14459:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788830707.213855:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830707.213982:0:15147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578433152 00000100:00100000:1.0:1788830707.213998:0:15147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578433152 00000100:00100000:1.0:1788830707.214101:0:15147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 4 00000100:00100000:1.0:1788830707.214114:0:15147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25658e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:5d08645c-98b4-449f-9d92-4c318beec94d+5:13844:x1875724578433152:12345-192.168.201.21@tcp:13:lfs.0 00002000:00000024:1.0:1788830707.214156:0:15147:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788830707.214262:0:15147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25658e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:5d08645c-98b4-449f-9d92-4c318beec94d+5:13844:x1875724578433152:12345-192.168.201.21@tcp:13:lfs.0 Request processed in 152us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830707.214270:0:15147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 4 00000100:00080000:2.0:1788830707.214421:0:14459:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788830707.216944:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830707.217546:0:15148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578433280 00000100:00100000:3.0:1788830707.217557:0:15148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578433280 00000100:00100000:3.0:1788830707.217633:0:15148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 5 00000100:00100000:3.0:1788830707.217644:0:15148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25747c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:5d08645c-98b4-449f-9d92-4c318beec94d+5:13844:x1875724578433280:12345-192.168.201.21@tcp:13:lfs.0 00002000:00000024:3.0:1788830707.217683:0:15148:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788830707.217802:0:15148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25747c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:5d08645c-98b4-449f-9d92-4c318beec94d+5:13844:x1875724578433280:12345-192.168.201.21@tcp:13:lfs.0 Request processed in 159us (868us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830707.217809:0:15148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 5 00000100:00080000:2.0:1788830707.218664:0:14459:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788830707.420352:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788830707.443660:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830707.443752:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578433408 00000100:00100000:3.0:1788830707.443775:0:14455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578433408 00000100:00100000:3.0:1788830707.443833:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 90 00000100:00100000:3.0:1788830707.443844:0:14455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e24451cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fe7320b8-b931-453c-a880-19896cc1f024+10:13876:x1875724578433408:12345-192.168.201.21@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788830707.443939:0:14455:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788830707.443957:0:14455:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2445f8e800/0x575506951eea1ede lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xa5789105346620da expref: -99 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830707.443987:0:14455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2445f8e800/0x575506951eea1ede lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.21@tcp remote: 0xa5789105346620da expref: 11 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830707.444000:0:14455:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2445f8e800/0x575506951eea1ede lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0xa5789105346620da expref: 11 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830707.444009:0:14455:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2445f8e800, rc 0) 00000100:00100000:3.0:1788830707.444136:0:14455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e24451cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fe7320b8-b931-453c-a880-19896cc1f024+11:13876:x1875724578433408:12345-192.168.201.21@tcp:101:mount.lustre.0 Request processed in 292us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830707.444143:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 90 00000100:00100000:0.0:1788830707.460351:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830707.461787:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578433536 00000100:00100000:2.0:1788830707.463666:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578433536 00000100:00100000:2.0:1788830707.463773:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 91 00000100:00100000:2.0:1788830707.463784:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e24451cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fe7320b8-b931-453c-a880-19896cc1f024+11:13876:x1875724578433536:12345-192.168.201.21@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788830707.464263:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e24451cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fe7320b8-b931-453c-a880-19896cc1f024+11:13876:x1875724578433536:12345-192.168.201.21@tcp:501:mount.lustre.0 Request processed in 478us (3920us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830707.464272:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 91 00000100:00100000:1.0:1788830707.469701:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830707.472887:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578433664 00000100:00100000:0.0:1788830707.472905:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578433664 00000100:00100000:0.0:1788830707.472985:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 92 00000100:00100000:0.0:1788830707.472996:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25428e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fe7320b8-b931-453c-a880-19896cc1f024+11:13876:x1875724578433664:12345-192.168.201.21@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788830707.473311:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25428e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fe7320b8-b931-453c-a880-19896cc1f024+11:13876:x1875724578433664:12345-192.168.201.21@tcp:503:mount.lustre.0 Request processed in 316us (3619us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830707.473320:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 92 00000100:00100000:0.0:1788830707.495887:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830707.496370:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578433792 00000100:00100000:0.0:1788830707.496380:0:14455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578433792 00000100:00100000:1.0:1788830707.496830:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 93 00000100:00100000:1.0:1788830707.496845:0:14455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25428e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fe7320b8-b931-453c-a880-19896cc1f024+11:13883:x1875724578433792:12345-192.168.201.21@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788830707.497256:0:14455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25428e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fe7320b8-b931-453c-a880-19896cc1f024+11:13883:x1875724578433792:12345-192.168.201.21@tcp:502:llog_process_th.0 Request processed in 414us (1377us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830707.497271:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 93 00000100:00100000:3.0:1788830707.508475:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830707.508792:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578433920 00000100:00100000:2.0:1788830707.508807:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578433920 00000100:00100000:2.0:1788830707.508881:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 94 00000100:00100000:2.0:1788830707.508894:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25428e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fe7320b8-b931-453c-a880-19896cc1f024+11:13883:x1875724578433920:12345-192.168.201.21@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788830707.509434:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25428e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fe7320b8-b931-453c-a880-19896cc1f024+11:13883:x1875724578433920:12345-192.168.201.21@tcp:502:llog_process_th.0 Request processed in 539us (973us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830707.509445:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 94 00000100:00100000:0.0:1788830707.518406:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830707.518752:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578434048 00000100:00100000:1.0:1788830707.518764:0:14455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578434048 00000100:00100000:1.0:1788830707.518821:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 95 00000100:00100000:1.0:1788830707.518831:0:14455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25428e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fe7320b8-b931-453c-a880-19896cc1f024+11:13876:x1875724578434048:12345-192.168.201.21@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788830707.518850:0:14455:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788830707.518871:0:14455:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e25820ff400/0x575506951eea1ee5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa578910534662104 expref: -99 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830707.518905:0:14455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e25820ff400/0x575506951eea1ee5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534662104 expref: 12 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830707.518918:0:14455:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e25820ff400/0x575506951eea1ee5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534662104 expref: 12 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830707.518927:0:14455:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e25820ff400, rc 0) 00000100:00100000:1.0:1788830707.519001:0:14455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25428e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fe7320b8-b931-453c-a880-19896cc1f024+12:13876:x1875724578434048:12345-192.168.201.21@tcp:101:mount.lustre.0 Request processed in 171us (605us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830707.519009:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 95 00000100:00100000:0.0:1788830707.529140:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830707.529240:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578434176 00000100:00100000:2.0:1788830707.529257:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578434176 00000100:00100000:2.0:1788830707.529386:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 96 00000100:00100000:2.0:1788830707.529398:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25428e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fe7320b8-b931-453c-a880-19896cc1f024+12:13876:x1875724578434176:12345-192.168.201.21@tcp:256:mount.lustre.0 20000000:01000000:2.0:1788830707.529437:0:14458:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788830707.529471:0:14458:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788830707.529476:0:14458:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788830707.529480:0:14458:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788830707.529488:0:14458:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:2.0:1788830707.531001:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25428e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fe7320b8-b931-453c-a880-19896cc1f024+12:13876:x1875724578434176:12345-192.168.201.21@tcp:256:mount.lustre.0 Request processed in 1593us (1859us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830707.531016:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 96 00000100:00100000:1.0:1788830707.534944:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830707.535109:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578434304 00000100:00100000:3.0:1788830707.535123:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578434304 00000100:00100000:3.0:1788830707.535246:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 97 00000100:00100000:3.0:1788830707.535262:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25428e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fe7320b8-b931-453c-a880-19896cc1f024+12:13876:x1875724578434304:12345-192.168.201.21@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788830707.535284:0:14457:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788830707.535324:0:14457:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2445f8fc00/0x575506951eea1eec lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa57891053466210b expref: -99 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830707.535360:0:14457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2445f8fc00/0x575506951eea1eec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.21@tcp remote: 0xa57891053466210b expref: 13 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830707.535400:0:14457:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2445f8fc00/0x575506951eea1eec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0xa57891053466210b expref: 13 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830707.535411:0:14457:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2445f8fc00, rc 0) 00000100:00100000:3.0:1788830707.535503:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25428e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fe7320b8-b931-453c-a880-19896cc1f024+13:13876:x1875724578434304:12345-192.168.201.21@tcp:101:mount.lustre.0 Request processed in 246us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830707.535510:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 97 00000100:00100000:1.0:1788830707.537958:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830707.538038:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578434432 00000100:00100000:2.0:1788830707.538051:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578434432 00000100:00100000:2.0:1788830707.538150:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 98 00000100:00100000:2.0:1788830707.538160:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25428e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fe7320b8-b931-453c-a880-19896cc1f024+13:13876:x1875724578434432:12345-192.168.201.21@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788830707.538621:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25428e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fe7320b8-b931-453c-a880-19896cc1f024+13:13876:x1875724578434432:12345-192.168.201.21@tcp:501:mount.lustre.0 Request processed in 461us (674us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830707.538631:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 98 00000100:00100000:0.0:1788830707.540535:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830707.540606:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578434560 00000100:00100000:3.0:1788830707.540617:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578434560 00000100:00100000:3.0:1788830707.540668:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 99 00000100:00100000:3.0:1788830707.540680:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25428e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fe7320b8-b931-453c-a880-19896cc1f024+13:13876:x1875724578434560:12345-192.168.201.21@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788830707.540974:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25428e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fe7320b8-b931-453c-a880-19896cc1f024+13:13876:x1875724578434560:12345-192.168.201.21@tcp:503:mount.lustre.0 Request processed in 294us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830707.540983:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 99 00000100:00100000:3.0:1788830707.543539:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830707.543763:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578434688 00000100:00100000:2.0:1788830707.543778:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578434688 00000100:00100000:2.0:1788830707.543856:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 100 00000100:00100000:2.0:1788830707.543869:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25428e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fe7320b8-b931-453c-a880-19896cc1f024+13:13887:x1875724578434688:12345-192.168.201.21@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788830707.544231:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25428e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fe7320b8-b931-453c-a880-19896cc1f024+13:13887:x1875724578434688:12345-192.168.201.21@tcp:502:llog_process_th.0 Request processed in 364us (704us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830707.544240:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 100 00000100:00100000:1.0:1788830707.553177:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830707.553320:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578434816 00000100:00100000:3.0:1788830707.553333:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578434816 00000100:00100000:3.0:1788830707.553408:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 101 00000100:00100000:3.0:1788830707.553422:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25428e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fe7320b8-b931-453c-a880-19896cc1f024+13:13887:x1875724578434816:12345-192.168.201.21@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788830707.554408:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25428e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fe7320b8-b931-453c-a880-19896cc1f024+13:13887:x1875724578434816:12345-192.168.201.21@tcp:502:llog_process_th.0 Request processed in 983us (1241us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830707.554421:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 101 00000100:00100000:0.0:1788830707.563469:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830707.566125:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830707.566181:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830707.566257:0:14465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578434944 00000100:00100000:0.0:1788830707.566271:0:14465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578434944 00000100:00100000:3.0:1788830707.566335:0:14464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578435328 00000100:00100000:3.0:1788830707.566340:0:14464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578435328 00000100:00100000:0.0:1788830707.566345:0:14465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 10 00000100:00100000:0.0:1788830707.566354:0:14465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25658c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2351:x1875724578434944:12345-192.168.201.21@tcp:38:mount.lustre.0 00000100:00100000:3.0:1788830707.566375:0:14464:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788830707.566385:0:14464:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00010000:00080000:0.0:1788830707.566395:0:14465:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from ade59d61-740e-497b-bdec-03aa0b1957da@192.168.201.21@tcp t0 exp 0000000000000000 cur 460 last 0 00000020:00000080:0.0:1788830707.566453:0:14465:0:(genops.c:1385:class_connect()) connect: client ade59d61-740e-497b-bdec-03aa0b1957da, cookie 0x575506951eea1ef3 00000100:00100000:3.0:1788830707.566542:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 14 00000100:00100000:3.0:1788830707.566550:0:14464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25658c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d08645c-98b4-449f-9d92-4c318beec94d+7:2352:x1875724578435328:12345-192.168.201.21@tcp:400:kworker.0 00000004:00100000:0.0:1788830707.566632:0:14465:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788830707.566891:0:14465:0:(import.c:65:import_set_state_nolock()) ffff9e2444858000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788830707.566961:0:14464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25658c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d08645c-98b4-449f-9d92-4c318beec94d+7:2352:x1875724578435328:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 410us (777us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830707.566970:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 14 00000100:00100000:1.0:1788830707.568423:0:15144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578435456 00000100:00100000:1.0:1788830707.568877:0:15144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578435456 00000100:00100000:1.0:1788830707.568944:0:15144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 2 00000100:00100000:1.0:1788830707.568958:0:15144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25478b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5d08645c-98b4-449f-9d92-4c318beec94d+5:2352:x1875724578435456:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:0.0:1788830707.573398:0:14465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25658c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ade59d61-740e-497b-bdec-03aa0b1957da+6:2351:x1875724578434944:12345-192.168.201.21@tcp:38:mount.lustre.0 Request processed in 7022us (7266us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830707.573421:0:14465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 10 00000100:00100000:3.0:1788830707.575554:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830707.576241:0:15145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578435584 00000100:00100000:3.0:1788830707.576256:0:15145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578435584 00000100:00100000:3.0:1788830707.576815:0:15145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 3 00000100:00100000:3.0:1788830707.576830:0:15145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25658e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5d08645c-98b4-449f-9d92-4c318beec94d+5:2352:x1875724578435584:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:3.0:1788830707.576927:0:15145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25658e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5d08645c-98b4-449f-9d92-4c318beec94d+5:2352:x1875724578435584:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 102us (1387us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830707.576935:0:15145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 3 00000100:00100000:1.0:1788830707.577375:0:15144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25478b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5d08645c-98b4-449f-9d92-4c318beec94d+5:2352:x1875724578435456:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 8417us (13919us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830707.577386:0:15144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 2 00000100:00100000:2.0:1788830707.591961:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830707.592036:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830707.592421:0:16335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578435072 00000100:00100000:0.0:1788830707.592442:0:16335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578435072 00000100:00080000:2.0:1788830707.592602:0:14459:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788830707.592657:0:16335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578435200 00000100:00100000:0.0:1788830707.592662:0:16335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578435200 00000100:00100000:0.0:1788830707.592699:0:16335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 11 00000100:00100000:0.0:1788830707.592750:0:16335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25658c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ade59d61-740e-497b-bdec-03aa0b1957da+7:0:x1875724578435072:12345-192.168.201.21@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788830707.592793:0:16335:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788830707.592900:0:16335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25658c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ade59d61-740e-497b-bdec-03aa0b1957da+7:0:x1875724578435072:12345-192.168.201.21@tcp:41:mount.lustre.0 Request processed in 190us (955us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830707.592908:0:16335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 11 00000100:00100000:0.0:1788830707.592929:0:16335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 12 00000100:00100000:0.0:1788830707.592936:0:16335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25658c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ade59d61-740e-497b-bdec-03aa0b1957da+6:13876:x1875724578435200:12345-192.168.201.21@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788830707.592949:0:16335:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788830707.592972:0:16335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25658c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ade59d61-740e-497b-bdec-03aa0b1957da+6:13876:x1875724578435200:12345-192.168.201.21@tcp:41:mount.lustre.0 Request processed in 36us (935us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830707.592978:0:16335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 12 00000100:00100000:2.0:1788830707.599041:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830707.599404:0:16335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578435712 00000100:00100000:0.0:1788830707.599419:0:16335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578435712 00000100:00100000:0.0:1788830707.599690:0:16335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 13 00000100:00100000:0.0:1788830707.599703:0:16335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25658c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ade59d61-740e-497b-bdec-03aa0b1957da+6:13876:x1875724578435712:12345-192.168.201.21@tcp:40:mount.lustre.0 00000100:00100000:0.0:1788830707.599895:0:16335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25658c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ade59d61-740e-497b-bdec-03aa0b1957da+6:13876:x1875724578435712:12345-192.168.201.21@tcp:40:mount.lustre.0 Request processed in 194us (868us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830707.599922:0:16335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 13 00000100:00100000:3.0:1788830707.603556:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830707.603602:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830707.603627:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830707.603662:0:15939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578435840 00000100:00100000:3.0:1788830707.603673:0:15939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578435840 00000100:00100000:3.0:1788830707.603759:0:15939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578435968 00000100:00100000:3.0:1788830707.603762:0:15939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578435968 00000100:00100000:3.0:1788830707.603781:0:15939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 8 00000100:00100000:3.0:1788830707.603791:0:15939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25658e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2351:x1875724578435840:12345-192.168.201.21@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788830707.603830:0:15939:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from ade59d61-740e-497b-bdec-03aa0b1957da@192.168.201.21@tcp t0 exp 0000000000000000 cur 460 last 0 00000020:00000080:3.0:1788830707.603873:0:15939:0:(genops.c:1385:class_connect()) connect: client ade59d61-740e-497b-bdec-03aa0b1957da, cookie 0x575506951eea1efa 00002000:00100000:3.0:1788830707.603897:0:15939:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli ade59d61-740e-497b-bdec-03aa0b1957da/ffff9e2545170000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113968 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788830707.603911:0:15939:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788830707.604220:0:15939:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788830707.604277:0:15939:0:(import.c:65:import_set_state_nolock()) ffff9e2544c04800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788830707.604377:0:15939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25658e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ade59d61-740e-497b-bdec-03aa0b1957da+6:2351:x1875724578435840:12345-192.168.201.21@tcp:8:mount.lustre.0 Request processed in 585us (772us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830707.604385:0:15939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 8 00000100:00100000:3.0:1788830707.604407:0:15939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 9 00000100:00100000:3.0:1788830707.604412:0:15939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25658e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2351:x1875724578435968:12345-192.168.201.21@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788830707.604429:0:15939:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from ade59d61-740e-497b-bdec-03aa0b1957da@192.168.201.21@tcp t0 exp 0000000000000000 cur 460 last 0 00000020:00000080:3.0:1788830707.604447:0:15939:0:(genops.c:1385:class_connect()) connect: client ade59d61-740e-497b-bdec-03aa0b1957da, cookie 0x575506951eea1f01 00002000:00100000:3.0:1788830707.604453:0:15939:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli ade59d61-740e-497b-bdec-03aa0b1957da/ffff9e2544c05000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113968 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788830707.604462:0:15939:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788830707.604608:0:15939:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788830707.604625:0:15939:0:(import.c:65:import_set_state_nolock()) ffff9e2544c06800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788830707.604651:0:15939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25658e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ade59d61-740e-497b-bdec-03aa0b1957da+6:2351:x1875724578435968:12345-192.168.201.21@tcp:8:mount.lustre.0 Request processed in 238us (1023us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830707.604658:0:15939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 9 00000100:00100000:1.0:1788830707.607239:0:14467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578436096 00000100:00100000:1.0:1788830707.607260:0:14467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578436096 00000100:00100000:1.0:1788830707.607342:0:14467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 1 00000100:00100000:1.0:1788830707.607355:0:14467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25658e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ade59d61-740e-497b-bdec-03aa0b1957da+6:13876:x1875724578436096:12345-192.168.201.21@tcp:33:mount.lustre.0 00000004:00200000:1.0:1788830707.607477:0:14467:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1788830707.608366:0:14467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25658e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ade59d61-740e-497b-bdec-03aa0b1957da+6:13876:x1875724578436096:12345-192.168.201.21@tcp:33:mount.lustre.0 Request processed in 1006us (4816us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830707.608378:0:14467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 1 00000100:00100000:3.0:1788830707.800151:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830707.800346:0:14463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578436224 00000100:00100000:1.0:1788830707.800359:0:14463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578436224 00000100:00100000:1.0:1788830707.800430:0:14463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 14 00000100:00100000:1.0:1788830707.800441:0:14463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25658e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ade59d61-740e-497b-bdec-03aa0b1957da+6:13908:x1875724578436224:12345-192.168.201.21@tcp:101:mkdir.0 00010000:00010000:1.0:1788830707.800468:0:14463:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788830707.800605:0:14463:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffa00/0x575506951eea1f08 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa578910534662135 expref: -99 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830707.800689:0:14463:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea1f0f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830707.800704:0:14463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea1f0f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830707.800940:0:14463:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea1f0f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14463 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788830707.801071:0:14463:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788830707.801076:0:14463:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788830707.801097:0:14463:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea1f0f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830707.801130:0:14463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffa00/0x575506951eea1f08 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534662135 expref: 8 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830707.801151:0:14463:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea1f0f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0xa578910534662135 expref: 7 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830707.801161:0:14463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e257480c100) 00010000:00010000:1.0:1788830707.801164:0:14463:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788830707.801168:0:14463:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e25820ff800, rc 0) 00000100:00100000:1.0:1788830707.801320:0:14463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25658e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ade59d61-740e-497b-bdec-03aa0b1957da+7:13908:x1875724578436224:12345-192.168.201.21@tcp:101:mkdir.0 Request processed in 878us (1182us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830707.801328:0:14463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 14 00000100:00100000:3.0:1788830707.932107:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257f727b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875724595201536:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788830707.932223:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830707.933239:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25478b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875724595201792:0@lo:400:kworker.0 00000100:00100000:0.0:1788830707.933308:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830707.933349:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788830707.933356:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25478b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875724595201920:0@lo:400:kworker.0 00000100:00100000:0.0:1788830707.933386:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830707.933646:0:15939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595201792 00000100:00100000:3.0:1788830707.933656:0:15939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595201792 00000100:00100000:3.0:1788830707.933768:0:15939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788830707.933781:0:15148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595201536 00000100:00100000:3.0:1788830707.933782:0:15939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25478b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1875724595201792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788830707.933811:0:15148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595201536 00000100:00100000:3.0:1788830707.933865:0:15939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25478b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1875724595201792:12345-0@lo:400:kworker.0 Request processed in 87us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830707.933875:0:15939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788830707.933897:0:15148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788830707.933915:0:15148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25658e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875724595201536:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788830707.933944:0:15148:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788830707.933954:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25478b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3689682b-484d-410c-a8fd-1b98c0369c65:3310:1875724595201664:0@lo:400:kworker.0 00000100:00100000:3.0:1788830707.934018:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830707.934064:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25478b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1875724595202176:0@lo:400:kworker.0 00000100:00100000:2.0:1788830707.934072:0:15148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25658e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875724595201536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 150us (1834us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830707.934080:0:15148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788830707.934203:0:14465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595201920 00000100:00100000:2.0:1788830707.934209:0:14465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595201920 00000100:00100000:3.0:1788830707.934223:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788830707.934251:0:14465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595202176 00000100:00100000:3.0:1788830707.934255:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788830707.934258:0:14465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595202176 00000100:00100000:3.0:1788830707.934266:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25478b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1875724595202048:0@lo:400:kworker.0 00000100:00100000:2.0:1788830707.934303:0:14463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788830707.934311:0:14463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25478b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875724595201920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788830707.934358:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788830707.934369:0:14463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25478b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875724595201920:12345-0@lo:400:kworker.0 Request processed in 54us (977us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830707.934378:0:14463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788830707.934405:0:14463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595202048 00000100:00100000:2.0:1788830707.934409:0:14463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595202048 00000100:00100000:3.0:1788830707.934446:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257f727b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875724595201536:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788830707.934456:0:14463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788830707.934481:0:14463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25658e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875724595202176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788830707.934524:0:14463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25658e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875724595202176:12345-0@lo:400:kworker.0 Request processed in 47us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830707.934531:0:14463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788830707.934615:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595201664 00000100:00100000:3.0:1788830707.934622:0:14455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595201664 00000100:00100000:3.0:1788830707.934662:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788830707.934670:0:14455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25428e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3689682b-484d-410c-a8fd-1b98c0369c65+19:3310:x1875724595201664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788830707.934740:0:14455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25428e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3689682b-484d-410c-a8fd-1b98c0369c65+19:3310:x1875724595201664:12345-0@lo:400:kworker.0 Request processed in 70us (721us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830707.934747:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788830707.934786:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25478b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3689682b-484d-410c-a8fd-1b98c0369c65:3310:1875724595201664:0@lo:400:kworker.0 00000100:00100000:3.0:1788830707.934800:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25478b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1875724595202176:0@lo:400:kworker.0 00000100:00100000:3.0:1788830707.934831:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788830707.934839:0:14464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25658e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875724595202048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788830707.934894:0:14464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25658e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875724595202048:12345-0@lo:400:kworker.0 Request processed in 54us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830707.934901:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788830707.934950:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25478b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1875724595202048:0@lo:400:kworker.0 00000100:00080000:0.0:1788830707.936024:0:14459:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788830707.936035:0:14459:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788830707.936039:0:14459:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788830707.936097:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25478b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875724595201920:0@lo:400:kworker.0 00000100:00100000:0.0:1788830707.936115:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25478b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875724595201792:0@lo:400:kworker.0 00000100:00100000:2.0:1788830707.940391:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788830707.940415:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25747c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875724595202304:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788830707.940865:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830707.941211:0:15148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595202304 00000100:00100000:3.0:1788830707.941226:0:15148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595202304 00000100:00100000:3.0:1788830707.941282:0:15148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788830707.941293:0:15148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257f725c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875724595202304:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788830707.941316:0:15148:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788830707.941372:0:15148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257f725c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875724595202304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830707.941380:0:15148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788830707.941691:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25747c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875724595202304:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788830708.444834:0:15935:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788830709.467931:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788830710.031656:0:5855:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of ade59d61-740e-497b-bdec-03aa0b1957da 00000001:00100000:3.0:1788830710.031856:0:5855:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 5d08645c-98b4-449f-9d92-4c318beec94d 00000001:02000400:2.0:1788830710.381753:0:16422:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1788830710.494961:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788830710.532173:0:6709:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ade59d61-740e-497b-bdec-03aa0b1957da 00010000:00010000:3.0:1788830711.519883:0:15935:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788830712.072267:0:7646:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ade59d61-740e-497b-bdec-03aa0b1957da 00010000:00010000:1.0:1788830712.541199:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788830712.714025:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830712.714072:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830712.714092:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830712.714122:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830712.714142:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830712.714159:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830712.714179:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830712.714202:0:14463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578436864 00000100:00100000:2.0:1788830712.714213:0:14463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578436864 00000100:00100000:2.0:1788830712.714267:0:14463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578436480 00000100:00100000:2.0:1788830712.714271:0:14463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578436480 00000100:00100000:2.0:1788830712.714294:0:14463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 18 00000100:00100000:2.0:1788830712.714303:0:14463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257f724a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ade59d61-740e-497b-bdec-03aa0b1957da+6:2355:x1875724578436864:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:2.0:1788830712.714385:0:14463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257f724a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ade59d61-740e-497b-bdec-03aa0b1957da+6:2355:x1875724578436864:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 83us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830712.714393:0:14463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 18 00000100:00100000:2.0:1788830712.714409:0:14463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 19 00000100:00100000:2.0:1788830712.714415:0:14463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257f726a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d08645c-98b4-449f-9d92-4c318beec94d+6:2355:x1875724578436480:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:2.0:1788830712.714439:0:14463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257f726a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d08645c-98b4-449f-9d92-4c318beec94d+6:2355:x1875724578436480:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 24us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830712.714445:0:14463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 19 00000100:00080000:0.0:1788830712.715023:0:14459:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788830712.715442:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578436352 00000100:00100000:3.0:1788830712.715449:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578436352 00000100:00100000:3.0:1788830712.715488:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 103 00000100:00100000:3.0:1788830712.715497:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25428e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fe7320b8-b931-453c-a880-19896cc1f024+13:2355:x1875724578436352:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:3.0:1788830712.715544:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25428e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fe7320b8-b931-453c-a880-19896cc1f024+13:2355:x1875724578436352:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 47us (1527us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830712.715551:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 103 00000100:00100000:3.0:1788830712.715581:0:15145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578436608 00000100:00100000:3.0:1788830712.715584:0:15145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578436608 00000100:00100000:3.0:1788830712.715611:0:15145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578437120 00000100:00100000:3.0:1788830712.715615:0:15145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578437120 00000100:00100000:3.0:1788830712.715629:0:15145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578436736 00000100:00100000:3.0:1788830712.715632:0:15145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578436736 00000100:00100000:3.0:1788830712.715642:0:15145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578436992 00000100:00100000:3.0:1788830712.715644:0:15145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578436992 00000100:00100000:3.0:1788830712.715657:0:15145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 5 00000100:00100000:3.0:1788830712.715664:0:15145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257f725f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5d08645c-98b4-449f-9d92-4c318beec94d+5:2355:x1875724578436608:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:3.0:1788830712.715690:0:15145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257f725f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5d08645c-98b4-449f-9d92-4c318beec94d+5:2355:x1875724578436608:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 27us (1619us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830712.715704:0:15145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 5 00000100:00100000:3.0:1788830712.715739:0:15145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 6 00000100:00100000:3.0:1788830712.715746:0:15145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257f724700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ade59d61-740e-497b-bdec-03aa0b1957da+5:2355:x1875724578437120:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:3.0:1788830712.715771:0:15145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257f724700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ade59d61-740e-497b-bdec-03aa0b1957da+5:2355:x1875724578437120:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 27us (1649us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830712.715777:0:15145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 6 00000100:00100000:3.0:1788830712.715786:0:15145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 7 00000100:00100000:3.0:1788830712.715792:0:15145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257f725180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5d08645c-98b4-449f-9d92-4c318beec94d+5:2355:x1875724578436736:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:3.0:1788830712.715811:0:15145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257f725180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5d08645c-98b4-449f-9d92-4c318beec94d+5:2355:x1875724578436736:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 20us (1652us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830712.715816:0:15145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 7 00000100:00100000:3.0:1788830712.715826:0:15145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 8 00000100:00100000:3.0:1788830712.715832:0:15145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257f726d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ade59d61-740e-497b-bdec-03aa0b1957da+5:2355:x1875724578436992:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:3.0:1788830712.715853:0:15145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257f726d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ade59d61-740e-497b-bdec-03aa0b1957da+5:2355:x1875724578436992:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 22us (1674us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830712.715859:0:15145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 8 00000100:00080000:3.0:1788830712.716016:0:14459:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788830712.716019:0:14459:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788830713.051891:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257f727100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875724595202432:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788830713.051973:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830713.052096:0:15148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595202432 00000100:00100000:3.0:1788830713.052115:0:15148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595202432 00000100:00100000:3.0:1788830713.052183:0:15148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788830713.052190:0:15147:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:3.0:1788830713.052196:0:15148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25658e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875724595202432:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788830713.052202:0:15147:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00002000:00000024:3.0:1788830713.052244:0:15148:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788830713.052292:0:15148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25658e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875724595202432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830713.052300:0:15148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:3.0:1788830713.052324:0:14459:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788830713.052359:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257f727100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875724595202432:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788830713.058411:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257f726300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3689682b-484d-410c-a8fd-1b98c0369c65:3309:1875724595202560:0@lo:400:kworker.0 00000100:00100000:2.0:1788830713.058490:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788830713.058529:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257f724e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1875724595203072:0@lo:400:kworker.0 00000100:00100000:2.0:1788830713.058556:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788830713.058581:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788830713.058586:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257f724000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875724595202688:0@lo:400:kworker.0 00000100:00100000:2.0:1788830713.058610:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788830713.058646:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595202560 00000100:00100000:2.0:1788830713.058654:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595202560 00000100:00100000:2.0:1788830713.058697:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788830713.058751:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257e966450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3689682b-484d-410c-a8fd-1b98c0369c65+19:3309:x1875724595202560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788830713.058816:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257e966450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3689682b-484d-410c-a8fd-1b98c0369c65+19:3309:x1875724595202560:12345-0@lo:400:kworker.0 Request processed in 110us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830713.058825:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788830713.058831:0:14463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595203072 00000100:00100000:3.0:1788830713.058846:0:14463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595203072 00000100:00100000:2.0:1788830713.058887:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257f726300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3689682b-484d-410c-a8fd-1b98c0369c65:3309:1875724595202560:0@lo:400:kworker.0 00000100:00100000:3.0:1788830713.058951:0:14463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788830713.058965:0:14463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257f727480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875724595203072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788830713.059174:0:14463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257f727480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875724595203072:12345-0@lo:400:kworker.0 Request processed in 212us (616us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830713.059476:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25747c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875724595203200:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788830713.059519:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830713.059554:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257f724380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875724595202816:0@lo:400:kworker.0 00000100:00100000:1.0:1788830713.059575:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830713.059593:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788830713.059598:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257f725500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1875724595202944:0@lo:400:kworker.0 00000100:00100000:1.0:1788830713.059616:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830713.059638:0:14464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595202816 00000100:00100000:1.0:1788830713.059648:0:14464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595202816 00000100:00100000:2.0:1788830713.060208:0:14465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595202944 00000100:00100000:2.0:1788830713.060214:0:14465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595202944 00000100:00100000:2.0:1788830713.060240:0:14465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788830713.060249:0:14465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25747c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875724595202944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788830713.060300:0:14465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25747c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875724595202944:12345-0@lo:400:kworker.0 Request processed in 52us (682us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830713.060307:0:14465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788830713.060345:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257f724e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1875724595203072:0@lo:400:kworker.0 00000100:00100000:2.0:1788830713.060398:0:15145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595202688 00000100:00100000:2.0:1788830713.060402:0:15145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595202688 00000100:00100000:2.0:1788830713.060429:0:15145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788830713.060443:0:15145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257f725880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875724595202688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788830713.060478:0:15145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257f725880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875724595202688:12345-0@lo:400:kworker.0 Request processed in 37us (1867us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830713.060485:0:15145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788830713.060507:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257f724000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875724595202688:0@lo:400:kworker.0 00000100:00080000:2.0:1788830713.060536:0:14459:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788830713.060541:0:14459:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788830713.060558:0:15148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595203200 00000100:00100000:2.0:1788830713.060562:0:15148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595203200 00000100:00100000:2.0:1788830713.060584:0:15148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788830713.060591:0:15148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25747c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875724595203200:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788830713.060617:0:15148:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788830713.060651:0:15148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25747c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875724595203200:12345-0@lo:13:osp-pre-1-0.0 Request processed in 61us (1132us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830713.060657:0:15148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788830713.062364:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257f725500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1875724595202944:0@lo:400:kworker.0 00000100:00100000:0.0:1788830713.062408:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25747c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875724595203200:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788830713.063867:0:14463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788830713.065772:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788830713.065796:0:14464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25747c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875724595202816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788830713.066315:0:14464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25747c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875724595202816:12345-0@lo:400:kworker.0 Request processed in 528us (6736us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830713.066325:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788830713.066417:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257f724380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875724595202816:0@lo:400:kworker.0 00010000:00010000:0.0:1788830713.573358:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788830713.687478:0:16575:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc93498f10 20000000:00000080:3.0:1788830713.687497:0:16575:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9e2445f76000 uarg=0000000000000000 20000000:01000000:3.0:1788830713.687535:0:16575:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788830713.687541:0:16575:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788830713.687546:0:16575:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1788830713.688481:0:16576:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:3.0:1788830713.688686:0:16575:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1788830713.700758:0:16575:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788830713.700784:0:16575:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2445f8ee00/0x575506951eea1f16 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830713.700803:0:16575:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e257fa8c000/0x575506951eea1c0d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x575506951eea1c06 expref: 18 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830713.700812:0:16575:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2565728400/0x575506951eea1c5a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x575506951eea1c53 expref: 18 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830713.700833:0:16575:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e257fa8ce00/0x575506951eea1cca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x575506951eea1cc3 expref: 18 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830713.700842:0:16575:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2445f8fa00/0x575506951eea1eb4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0xa5789105346620a9 expref: 12 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830713.700850:0:16575:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2445f8fc00/0x575506951eea1eec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0xa57891053466210b expref: 12 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830713.700856:0:16575:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2445f8ee00/0x575506951eea1f16 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830713.700900:0:16575:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2445f8fc00/0x575506951eea1eec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.21@tcp remote: 0xa57891053466210b expref: 12 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830713.700913:0:16575:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e2445f8fc00/0x575506951eea1eec lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.21@tcp remote: 0xa57891053466210b expref: 12 pid: 14457 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788830713.700928:0:16575:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2545cbe680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16575:1875724595203328:192.168.201.21@tcp:104: 00010000:00010000:3.0:1788830713.701045:0:16575:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2445f8fa00/0x575506951eea1eb4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.21@tcp remote: 0xa5789105346620a9 expref: 12 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830713.701053:0:16575:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e2445f8fa00/0x575506951eea1eb4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.21@tcp remote: 0xa5789105346620a9 expref: 12 pid: 14455 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788830713.701060:0:16575:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2545cbfb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16575:1875724595203456:192.168.201.21@tcp:104: 00010000:00010000:3.0:1788830713.701097:0:16575:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e257fa8ce00/0x575506951eea1cca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x575506951eea1cc3 expref: 18 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830713.701117:0:16575:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e257fa8ce00/0x575506951eea1cca lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x575506951eea1cc3 expref: 18 pid: 14457 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788830713.701126:0:16575:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2545cbdc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16575:1875724595203584:0@lo:104: 00000100:00100000:3.0:1788830713.701177:0:16575:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788830713.701213:0:16575:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2565728400/0x575506951eea1c5a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x575506951eea1c53 expref: 18 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830713.701221:0:16575:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e2565728400/0x575506951eea1c5a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x575506951eea1c53 expref: 18 pid: 14457 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788830713.701229:0:16575:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2545cbca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16575:1875724595203712:0@lo:104: 00000100:00100000:3.0:1788830713.701255:0:16575:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788830713.701288:0:16575:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e257fa8c000/0x575506951eea1c0d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x575506951eea1c06 expref: 18 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830713.701296:0:16575:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e257fa8c000/0x575506951eea1c0d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x575506951eea1c06 expref: 18 pid: 14458 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788830713.701304:0:16575:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257f731f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16575:1875724595203840:0@lo:104: 00000100:00100000:2.0:1788830713.701307:0:14447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595203584 00000100:00100000:2.0:1788830713.701316:0:14447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595203584 00000100:00100000:3.0:1788830713.701328:0:16575:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830713.701338:0:16575:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2565b94840 going to sleep for 11 seconds 00000100:00100000:2.0:1788830713.701363:0:14447:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788830713.701373:0:14447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595203712 00000100:00100000:2.0:1788830713.701377:0:14447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595203712 00000100:00100000:2.0:1788830713.701388:0:14447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595203840 00000100:00100000:2.0:1788830713.701390:0:14447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595203840 00000100:00100000:2.0:1788830713.701404:0:14447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788830713.701413:0:14447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2545cbc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3689682b-484d-410c-a8fd-1b98c0369c65+5:16575:x1875724595203584:12345-0@lo:104: 00010000:00010000:2.0:1788830713.701426:0:14447:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.121@tcp lock: ffff9e257d944400/0x575506951eea1cc3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x575506951eea1cca expref: -99 pid: 15860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830713.701490:0:14447:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788830713.701501:0:14447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2545cbc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3689682b-484d-410c-a8fd-1b98c0369c65+5:16575:x1875724595203584:12345-0@lo:104: Request processed in 89us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830713.701508:0:14447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788830713.701525:0:14447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788830713.701532:0:14447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257f733480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3689682b-484d-410c-a8fd-1b98c0369c65+4:16575:x1875724595203712:12345-0@lo:104: 00010000:00010000:2.0:1788830713.701541:0:14447:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.121@tcp lock: ffff9e2565728800/0x575506951eea1c53 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x575506951eea1c5a expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830713.701586:0:14447:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788830713.701591:0:14447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257f733480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3689682b-484d-410c-a8fd-1b98c0369c65+4:16575:x1875724595203712:12345-0@lo:104: Request processed in 61us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830713.701596:0:14447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788830713.701609:0:14447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788830713.701614:0:14447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25475bb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3689682b-484d-410c-a8fd-1b98c0369c65+3:16575:x1875724595203840:12345-0@lo:104: 00010000:00010000:2.0:1788830713.701622:0:14447:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.121@tcp lock: ffff9e25658d6600/0x575506951eea1c06 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x575506951eea1c0d expref: -99 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830713.701651:0:14452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788830713.701660:0:14447:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788830713.701744:0:16575:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2545cbdc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16575:1875724595203584:0@lo:104: 00000100:00100000:3.0:1788830713.701756:0:16575:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2545cbca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16575:1875724595203712:0@lo:104: 00000100:00100000:3.0:1788830713.701763:0:16575:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257f731f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16575:1875724595203840:0@lo:104: 00000100:00100000:2.0:1788830713.701934:0:14447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25475bb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3689682b-484d-410c-a8fd-1b98c0369c65+3:16575:x1875724595203840:12345-0@lo:104: Request processed in 319us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830713.701941:0:14447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:2.0:1788830713.702127:0:15935:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788830713.702134:0:15935:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.121@tcp lock: ffff9e2565728800/0x575506951eea1c53 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x575506951eea1c5a expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830713.702142:0:15935:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2565728800 already unused, calling callback (ffffffffc1aebc20) 00010000:00010000:0.0:1788830713.702145:0:14452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.121@tcp lock: ffff9e257d944400/0x575506951eea1cc3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x575506951eea1cca expref: -99 pid: 15860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788830713.702147:0:15935:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.121@tcp lock: ffff9e2565728800/0x575506951eea1c53 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x575506951eea1c5a expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830713.702169:0:15935:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.121@tcp lock: ffff9e2565728800/0x575506951eea1c53 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x575506951eea1c5a expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788830713.702176:0:15935:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.121@tcp lock: ffff9e2565728800/0x575506951eea1c53 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x575506951eea1c5a expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788830713.702182:0:15935:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788830713.702217:0:15935:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.121@tcp lock: ffff9e2565728800/0x575506951eea1c53 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x575506951eea1c5a expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830713.702221:0:14452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e257d944400 already unused, calling callback (ffffffffc1aebc20) 00010000:00010000:2.0:1788830713.702225:0:15935:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:00010000:0.0:1788830713.702234:0:14452:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.121@tcp lock: ffff9e257d944400/0x575506951eea1cc3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x575506951eea1cca expref: -99 pid: 15860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830713.702243:0:14452:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.121@tcp lock: ffff9e257d944400/0x575506951eea1cc3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x575506951eea1cca expref: -99 pid: 15860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788830713.702251:0:14452:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.121@tcp lock: ffff9e257d944400/0x575506951eea1cc3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x575506951eea1cca expref: -99 pid: 15860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788830713.702257:0:14452:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788830713.702258:0:15935:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.121@tcp lock: ffff9e2565728800/0x575506951eea1c53 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x575506951eea1c5a expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830713.702267:0:15935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.121@tcp lock: ffff9e2565728800/0x575506951eea1c53 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x575506951eea1c5a expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830713.702277:0:14452:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.121@tcp lock: ffff9e257d944400/0x575506951eea1cc3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x575506951eea1cca expref: -99 pid: 15860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830713.702279:0:15935:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788830713.702284:0:15935:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.121@tcp lock: ffff9e25658d6600/0x575506951eea1c06 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x575506951eea1c0d expref: -99 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830713.702289:0:14452:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788830713.702294:0:15935:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e25658d6600 already unused, calling callback (ffffffffc1aebc20) 10000000:00010000:2.0:1788830713.702298:0:15935:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.121@tcp lock: ffff9e25658d6600/0x575506951eea1c06 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x575506951eea1c0d expref: -99 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830713.702301:0:14452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.121@tcp lock: ffff9e257d944400/0x575506951eea1cc3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x575506951eea1cca expref: -99 pid: 15860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830713.702305:0:15935:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.121@tcp lock: ffff9e25658d6600/0x575506951eea1c06 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x575506951eea1c0d expref: -99 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830713.702312:0:14452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.121@tcp lock: ffff9e257d944400/0x575506951eea1cc3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x575506951eea1cca expref: -99 pid: 15860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788830713.702316:0:15935:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.121@tcp lock: ffff9e25658d6600/0x575506951eea1c06 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x575506951eea1c0d expref: -99 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830713.702326:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788830713.702329:0:15935:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788830713.702329:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788830713.702333:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788830713.702348:0:15935:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.121@tcp lock: ffff9e25658d6600/0x575506951eea1c06 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x575506951eea1c0d expref: -99 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830713.702355:0:15935:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788830713.702371:0:15935:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.121@tcp lock: ffff9e25658d6600/0x575506951eea1c06 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x575506951eea1c0d expref: -99 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830713.702378:0:15935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.121@tcp lock: ffff9e25658d6600/0x575506951eea1c06 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x575506951eea1c0d expref: -99 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830713.702391:0:15935:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788830713.702393:0:15935:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788830713.702394:0:15935:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788830713.702407:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25478b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3689682b-484d-410c-a8fd-1b98c0369c65:3308:1875724595204096:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788830713.702439:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788830713.702469:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788830713.702475:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257f724000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3689682b-484d-410c-a8fd-1b98c0369c65:3308:1875724595203968:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788830713.702493:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788830713.702515:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257f724e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3689682b-484d-410c-a8fd-1b98c0369c65:3309:1875724595204224:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788830713.702536:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830713.702559:0:14448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595204096 00000100:00100000:1.0:1788830713.702565:0:14448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595204096 00000100:00100000:2.0:1788830713.702574:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595203968 00000100:00100000:2.0:1788830713.702579:0:14449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595203968 00010000:00010000:1.0:1788830713.702591:0:14448:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e257fa8ce00/0x575506951eea1cca lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x575506951eea1cc3 expref: 20 pid: 14457 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830713.702597:0:14449:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2565728400/0x575506951eea1c5a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x575506951eea1c53 expref: 20 pid: 14457 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788830713.702613:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595204224 00000100:00100000:2.0:1788830713.702616:0:14449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595204224 00010000:00010000:2.0:1788830713.702633:0:14449:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e257fa8c000/0x575506951eea1c0d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x575506951eea1c06 expref: 21 pid: 14458 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788830713.702643:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788830713.702649:0:14449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257f726300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3689682b-484d-410c-a8fd-1b98c0369c65+21:3308:x1875724595204096:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788830713.702659:0:14449:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788830713.702664:0:14449:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e257fa8ce00/0x575506951eea1cca lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x575506951eea1cc3 expref: 21 pid: 14457 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830713.702680:0:14449:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e257fa8ce00/0x575506951eea1cca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x575506951eea1cc3 expref: 21 pid: 14457 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830713.702694:0:14449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e257fa8ce00/0x575506951eea1cca lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x575506951eea1cc3 expref: 21 pid: 14457 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788830713.702699:0:14448:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1788830713.702724:0:14448:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:1.0:1788830713.702829:0:14448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788830713.702836:0:14448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257f727800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3689682b-484d-410c-a8fd-1b98c0369c65+20:3308:x1875724595203968:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788830713.702845:0:14448:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788830713.702849:0:14448:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2565728400/0x575506951eea1c5a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x575506951eea1c53 expref: 20 pid: 14457 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830713.702857:0:14448:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2565728400/0x575506951eea1c5a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x575506951eea1c53 expref: 20 pid: 14457 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830713.702867:0:14448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2565728400/0x575506951eea1c5a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x575506951eea1c53 expref: 20 pid: 14457 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830713.702876:0:14448:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788830713.702910:0:14448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257f727800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3689682b-484d-410c-a8fd-1b98c0369c65+19:3308:x1875724595203968:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830713.702916:0:14448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788830713.702935:0:14448:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1788830713.702943:0:14448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788830713.702948:0:14448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257ede7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3689682b-484d-410c-a8fd-1b98c0369c65+18:3309:x1875724595204224:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788830713.702955:0:14448:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788830713.702958:0:14448:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e257fa8c000/0x575506951eea1c0d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x575506951eea1c06 expref: 18 pid: 14458 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830713.703027:0:14448:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e257fa8c000/0x575506951eea1c0d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x575506951eea1c06 expref: 18 pid: 14458 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830713.703039:0:14448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e257fa8c000/0x575506951eea1c0d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x575506951eea1c06 expref: 18 pid: 14458 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830713.703048:0:14448:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788830713.703076:0:14448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257ede7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3689682b-484d-410c-a8fd-1b98c0369c65+17:3309:x1875724595204224:12345-0@lo:103:ldlm_bl.0 Request processed in 128us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830713.703083:0:14448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1788830713.703479:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788830713.703548:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257f724000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3689682b-484d-410c-a8fd-1b98c0369c65:3308:1875724595203968:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788830713.703584:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257f724e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3689682b-484d-410c-a8fd-1b98c0369c65:3309:1875724595204224:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788830713.703829:0:14449:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788830713.704083:0:14449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257f726300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3689682b-484d-410c-a8fd-1b98c0369c65+16:3308:x1875724595204096:12345-0@lo:103:ldlm_bl.0 Request processed in 1433us (1641us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830713.704107:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788830713.704130:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25478b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3689682b-484d-410c-a8fd-1b98c0369c65:3308:1875724595204096:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788830713.708161:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830713.708237:0:14448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578437248 00000100:00100000:1.0:1788830713.708247:0:14448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578437248 00010000:00010000:1.0:1788830713.708289:0:14448:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2445f8fc00/0x575506951eea1eec lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.21@tcp remote: 0xa57891053466210b expref: 13 pid: 14457 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788830713.708329:0:14448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 7 00000100:00100000:1.0:1788830713.708339:0:14448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257f726680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fe7320b8-b931-453c-a880-19896cc1f024+13:2354:x1875724578437248:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788830713.708355:0:14448:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788830713.708361:0:14448:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2445f8fc00/0x575506951eea1eec lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.21@tcp remote: 0xa57891053466210b expref: 13 pid: 14457 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830713.708373:0:14448:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2445f8fc00/0x575506951eea1eec lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.21@tcp remote: 0xa57891053466210b expref: 13 pid: 14457 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830713.708406:0:14448:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788830713.708459:0:14448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257f726680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fe7320b8-b931-453c-a880-19896cc1f024+13:2354:x1875724578437248:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 121us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830713.708467:0:14448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 7 00010000:00010000:0.0:1788830713.708788:0:16575:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2445f8fc00/0x575506951eea1eec lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.21@tcp remote: 0xa57891053466210b expref: 12 pid: 14457 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788830713.708803:0:16575:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2545cbe680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16575:1875724595203328:192.168.201.21@tcp:104: 00000100:00100000:0.0:1788830713.708814:0:16575:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2545cbfb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16575:1875724595203456:192.168.201.21@tcp:104: 00010000:00010000:0.0:1788830713.708847:0:16575:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2445f8ee00/0x575506951eea1f16 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788830713.709668:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830713.709790:0:14450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578437376 00000100:00100000:0.0:1788830713.709796:0:14450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578437376 00010000:00010000:0.0:1788830713.709825:0:14450:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2445f8fa00/0x575506951eea1eb4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.201.21@tcp remote: 0xa5789105346620a9 expref: 12 pid: 14455 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788830713.709855:0:14450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 8 00000100:00100000:0.0:1788830713.709863:0:14450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257f727800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fe7320b8-b931-453c-a880-19896cc1f024+12:2355:x1875724578437376:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788830713.709874:0:14450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788830713.709879:0:14450:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2445f8fa00/0x575506951eea1eb4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.21@tcp remote: 0xa5789105346620a9 expref: 12 pid: 14455 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830713.709889:0:14450:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2445f8fa00/0x575506951eea1eb4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.21@tcp remote: 0xa5789105346620a9 expref: 12 pid: 14455 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830713.709903:0:14450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2445f8fa00/0x575506951eea1eb4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.21@tcp remote: 0xa5789105346620a9 expref: 12 pid: 14455 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830713.709916:0:14450:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2445f8ee00/0x575506951eea1f16 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830713.709924:0:14450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2445f8ee00/0x575506951eea1f16 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830713.709948:0:14450:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2445f8ee00/0x575506951eea1f16 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830713.709955:0:14450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2445f8ee00/0x575506951eea1f16 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830713.709962:0:14450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2445f8ee00/0x575506951eea1f16 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830713.709969:0:14450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2445f8ee00/0x575506951eea1f16 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830713.709975:0:14450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2445f8ee00 already unused, calling callback (ffffffffc14cb350) 00010000:00010000:0.0:1788830713.709978:0:14450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2445f8ee00/0x575506951eea1f16 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830713.709986:0:14450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2445f8ee00/0x575506951eea1f16 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830713.710005:0:14450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2445f8ee00/0x575506951eea1f16 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830713.710014:0:14450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788830713.710058:0:14450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257f727800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fe7320b8-b931-453c-a880-19896cc1f024+11:2355:x1875724578437376:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 196us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830713.710068:0:14450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 8 00010000:00010000:3.0:1788830713.710100:0:16575:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2445f8ee00/0x575506951eea1f16 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830713.710134:0:16575:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2445f8ee00/0x575506951eea1f16 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830713.710141:0:16575:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2445f8ee00/0x575506951eea1f16 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830714.587933:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788830714.843823:0:14460:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788830714.843842:0:14460:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e2545177800 from 10 10000000:01000000:3.0:1788830714.843849:0:14460:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788830714.843908:0:14460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.121@tcp lock: ffff9e2445f8ee00/0x575506951eea1f1d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830714.843920:0:14460:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.121@tcp lock: ffff9e2445f8ee00/0x575506951eea1f1d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830714.843932:0:14460:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.121@tcp lock: ffff9e2445f8ee00/0x575506951eea1f1d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788830714.843967:0:14460:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257f730a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3689682b-484d-410c-a8fd-1b98c0369c65:14460:1875724595204352:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788830714.844043:0:14460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830714.844125:0:14460:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2565b94240 going to sleep for 11 seconds 00000100:00100000:0.0:1788830714.844207:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595204352 00000100:00100000:0.0:1788830714.844216:0:14455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595204352 00000100:00100000:0.0:1788830714.844267:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788830714.844289:0:14455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257e966c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3689682b-484d-410c-a8fd-1b98c0369c65+16:14460:x1875724595204352:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788830714.844302:0:14455:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788830714.844314:0:14455:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e25658d7a00/0x575506951eea1f24 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x575506951eea1f1d expref: -99 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830714.844336:0:14455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e25658d7a00/0x575506951eea1f24 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x575506951eea1f1d expref: 17 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830714.844345:0:14455:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e25658d7a00/0x575506951eea1f24 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x575506951eea1f1d expref: 17 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830714.844354:0:14455:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e25658d7a00, rc 0) 00000100:00100000:0.0:1788830714.844404:0:14455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257e966c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3689682b-484d-410c-a8fd-1b98c0369c65+17:14460:x1875724595204352:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830714.844411:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788830714.844556:0:14460:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257f730a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3689682b-484d-410c-a8fd-1b98c0369c65:14460:1875724595204352:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788830714.844570:0:14460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.121@tcp lock: ffff9e2445f8ee00/0x575506951eea1f1d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea1f24 expref: -99 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830714.844580:0:14460:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.121@tcp lock: ffff9e2445f8ee00/0x575506951eea1f1d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x575506951eea1f24 expref: -99 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788830714.844631:0:14460:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257f730a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3689682b-484d-410c-a8fd-1b98c0369c65:14460:1875724595204480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788830714.844664:0:14460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830714.844689:0:14460:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2565b94240 going to sleep for 11 seconds 00000100:00100000:0.0:1788830714.844746:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595204480 00000100:00100000:0.0:1788830714.844750:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595204480 00000100:00100000:0.0:1788830714.844778:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788830714.844785:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257e965c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3689682b-484d-410c-a8fd-1b98c0369c65+17:14460:x1875724595204480:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788830714.845031:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257e965c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3689682b-484d-410c-a8fd-1b98c0369c65+17:14460:x1875724595204480:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 245us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830714.845038:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788830714.845190:0:14460:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257f730a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3689682b-484d-410c-a8fd-1b98c0369c65:14460:1875724595204480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788830714.845219:0:14460:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25747c2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3689682b-484d-410c-a8fd-1b98c0369c65:14460:1875724595204608:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788830714.845257:0:14460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830714.845287:0:14460:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2553736000 going to sleep for 11 seconds 00000100:00100000:3.0:1788830714.845342:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595204608 00000100:00100000:3.0:1788830714.845346:0:14455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595204608 00000100:00100000:3.0:1788830714.845364:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788830714.845370:0:14455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257e964050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3689682b-484d-410c-a8fd-1b98c0369c65+17:14460:x1875724595204608:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788830714.845517:0:14455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257e964050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3689682b-484d-410c-a8fd-1b98c0369c65+17:14460:x1875724595204608:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 146us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830714.845524:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788830714.845822:0:14460:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25747c2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3689682b-484d-410c-a8fd-1b98c0369c65:14460:1875724595204608:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788830714.847089:0:16644:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1788830714.847273:0:14460:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1788830714.847292:0:14460:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788830714.847302:0:14460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: ffff9e2445f8ee00/0x575506951eea1f1d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea1f24 expref: -99 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830714.847312:0:14460:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.121@tcp lock: ffff9e2445f8ee00/0x575506951eea1f1d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea1f24 expref: -99 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788830714.847322:0:14460:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788830714.847325:0:14460:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e2544c7e000 from 10 10000000:01000000:3.0:1788830714.847328:0:14460:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788830714.847359:0:14460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.121@tcp lock: ffff9e2445f8f000/0x575506951eea1f2b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830714.847367:0:14460:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.121@tcp lock: ffff9e2445f8f000/0x575506951eea1f2b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830714.847377:0:14460:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.121@tcp lock: ffff9e2445f8f000/0x575506951eea1f2b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788830714.847399:0:14460:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257f733100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3689682b-484d-410c-a8fd-1b98c0369c65:14460:1875724595204736:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788830714.847464:0:14460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830714.847548:0:14460:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2565b94240 going to sleep for 11 seconds 00000100:00100000:0.0:1788830714.847591:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595204736 00000100:00100000:0.0:1788830714.847598:0:14455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595204736 00000100:00100000:0.0:1788830714.847682:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788830714.847691:0:14455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257e967850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3689682b-484d-410c-a8fd-1b98c0369c65+17:14460:x1875724595204736:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788830714.847704:0:14455:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788830714.847753:0:14455:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e25658d6a00/0x575506951eea1f32 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x575506951eea1f2b expref: -99 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830714.847787:0:14455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e25658d6a00/0x575506951eea1f32 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x575506951eea1f2b expref: 18 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830714.847800:0:14455:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e25658d6a00/0x575506951eea1f32 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x575506951eea1f2b expref: 18 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830714.847809:0:14455:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e25658d6a00, rc 0) 00000100:00100000:0.0:1788830714.847852:0:14455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257e967850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3689682b-484d-410c-a8fd-1b98c0369c65+18:14460:x1875724595204736:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 162us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830714.847858:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788830714.847929:0:14460:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257f733100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3689682b-484d-410c-a8fd-1b98c0369c65:14460:1875724595204736:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788830714.847941:0:14460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.121@tcp lock: ffff9e2445f8f000/0x575506951eea1f2b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea1f32 expref: -99 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830714.847959:0:14460:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.121@tcp lock: ffff9e2445f8f000/0x575506951eea1f2b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x575506951eea1f32 expref: -99 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788830714.848003:0:14460:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257f733100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3689682b-484d-410c-a8fd-1b98c0369c65:14460:1875724595204864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788830714.848029:0:14460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830714.848395:0:14460:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2565b94240 going to sleep for 11 seconds 00000100:00100000:2.0:1788830714.848428:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595204864 00000100:00100000:2.0:1788830714.848434:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595204864 00000100:00100000:0.0:1788830714.848481:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788830714.848488:0:14455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257e964850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3689682b-484d-410c-a8fd-1b98c0369c65+18:14460:x1875724595204864:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788830714.848743:0:14455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257e964850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3689682b-484d-410c-a8fd-1b98c0369c65+18:14460:x1875724595204864:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 254us (712us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830714.848750:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788830714.848909:0:14460:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257f733100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3689682b-484d-410c-a8fd-1b98c0369c65:14460:1875724595204864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788830714.848940:0:14460:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257f733100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3689682b-484d-410c-a8fd-1b98c0369c65:14460:1875724595204992:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788830714.848992:0:14460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830714.849017:0:14460:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2565b94240 going to sleep for 11 seconds 00000100:00100000:1.0:1788830714.849119:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595204992 00000100:00100000:1.0:1788830714.849123:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595204992 00000100:00100000:1.0:1788830714.849141:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788830714.849146:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257e964450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3689682b-484d-410c-a8fd-1b98c0369c65+18:14460:x1875724595204992:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788830714.849283:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257e964450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3689682b-484d-410c-a8fd-1b98c0369c65+18:14460:x1875724595204992:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 135us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830714.849289:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788830714.849355:0:14460:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257f733100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3689682b-484d-410c-a8fd-1b98c0369c65:14460:1875724595204992:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788830714.850159:0:16645:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1788830714.850452:0:14460:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1788830714.850471:0:14460:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788830714.850481:0:14460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: ffff9e2445f8f000/0x575506951eea1f2b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea1f32 expref: -99 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830714.850492:0:14460:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.121@tcp lock: ffff9e2445f8f000/0x575506951eea1f2b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea1f32 expref: -99 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788830714.850518:0:14460:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788830714.850521:0:14460:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e25460f8000 from 10 10000000:01000000:1.0:1788830714.850524:0:14460:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788830714.850552:0:14460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.121@tcp lock: ffff9e25820ffa00/0x575506951eea1f39 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830714.850561:0:14460:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.121@tcp lock: ffff9e25820ffa00/0x575506951eea1f39 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830714.850572:0:14460:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.121@tcp lock: ffff9e25820ffa00/0x575506951eea1f39 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788830714.850591:0:14460:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25747c2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3689682b-484d-410c-a8fd-1b98c0369c65:14460:1875724595205120:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788830714.850635:0:14460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830714.850672:0:14460:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2553736840 going to sleep for 11 seconds 00000100:00100000:3.0:1788830714.850742:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595205120 00000100:00100000:3.0:1788830714.850747:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595205120 00000100:00100000:3.0:1788830714.850872:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788830714.850880:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257e967450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3689682b-484d-410c-a8fd-1b98c0369c65+18:14460:x1875724595205120:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788830714.850891:0:14458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788830714.850903:0:14458:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2445f8f600/0x575506951eea1f40 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x575506951eea1f39 expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830714.850936:0:14458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2445f8f600/0x575506951eea1f40 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x575506951eea1f39 expref: 19 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830714.851007:0:14458:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2445f8f600/0x575506951eea1f40 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x575506951eea1f39 expref: 19 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830714.851016:0:14458:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2445f8f600, rc 0) 00000100:00100000:3.0:1788830714.851091:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257e967450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3689682b-484d-410c-a8fd-1b98c0369c65+19:14460:x1875724595205120:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 211us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830714.851098:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788830714.851340:0:14460:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25747c2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3689682b-484d-410c-a8fd-1b98c0369c65:14460:1875724595205120:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788830714.851352:0:14460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.121@tcp lock: ffff9e25820ffa00/0x575506951eea1f39 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea1f40 expref: -99 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830714.851361:0:14460:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.121@tcp lock: ffff9e25820ffa00/0x575506951eea1f39 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x575506951eea1f40 expref: -99 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788830714.851409:0:14460:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25747c2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3689682b-484d-410c-a8fd-1b98c0369c65:14460:1875724595205248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788830714.851435:0:14460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830714.851498:0:14460:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2553736840 going to sleep for 11 seconds 00000100:00100000:2.0:1788830714.851524:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595205248 00000100:00100000:2.0:1788830714.851529:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595205248 00000100:00100000:2.0:1788830714.851585:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788830714.851594:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257e966850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3689682b-484d-410c-a8fd-1b98c0369c65+19:14460:x1875724595205248:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788830714.852036:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257e966850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3689682b-484d-410c-a8fd-1b98c0369c65+19:14460:x1875724595205248:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 443us (599us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830714.852044:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788830714.852101:0:14460:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25747c2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3689682b-484d-410c-a8fd-1b98c0369c65:14460:1875724595205248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788830714.852126:0:14460:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25747c2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3689682b-484d-410c-a8fd-1b98c0369c65:14460:1875724595205376:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788830714.852164:0:14460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788830714.852262:0:14460:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2553736840 going to sleep for 11 seconds 00000100:00100000:3.0:1788830714.852324:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595205376 00000100:00100000:3.0:1788830714.852329:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595205376 00000100:00100000:3.0:1788830714.852349:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788830714.852355:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257e967c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3689682b-484d-410c-a8fd-1b98c0369c65+19:14460:x1875724595205376:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788830714.852492:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257e967c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3689682b-484d-410c-a8fd-1b98c0369c65+19:14460:x1875724595205376:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 137us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830714.852499:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788830714.852557:0:14460:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25747c2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3689682b-484d-410c-a8fd-1b98c0369c65:14460:1875724595205376:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788830714.853423:0:16646:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1788830714.853621:0:14460:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1788830714.853642:0:14460:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788830714.853650:0:14460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: ffff9e25820ffa00/0x575506951eea1f39 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea1f40 expref: -99 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830714.853661:0:14460:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.121@tcp lock: ffff9e25820ffa00/0x575506951eea1f39 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x575506951eea1f40 expref: -99 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788830714.911250:0:14495:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788830715.141965:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830715.142032:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578437504 00000100:00100000:1.0:1788830715.142041:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578437504 00000100:00100000:1.0:1788830715.142127:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 114 00000100:00100000:1.0:1788830715.142138:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257e965850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fe7320b8-b931-453c-a880-19896cc1f024+11:13765:x1875724578437504:12345-192.168.201.21@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788830715.142216:0:14458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788830715.142284:0:14458:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e25658d6800/0x575506951eea1f47 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa57891053466213c expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830715.142311:0:14458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e25658d6800/0x575506951eea1f47 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.21@tcp remote: 0xa57891053466213c expref: 12 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830715.142319:0:14458:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e25658d6800/0x575506951eea1f47 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0xa57891053466213c expref: 12 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830715.142326:0:14458:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e25658d6800, rc 0) 00000100:00100000:0.0:1788830715.142376:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257e965850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fe7320b8-b931-453c-a880-19896cc1f024+12:13765:x1875724578437504:12345-192.168.201.21@tcp:101:ll_cfg_requeue.0 Request processed in 242us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830715.142393:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 114 00000100:00100000:1.0:1788830715.145550:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830715.145963:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578437632 00000100:00100000:3.0:1788830715.145985:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578437632 00000100:00100000:3.0:1788830715.146042:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 115 00000100:00100000:3.0:1788830715.146053:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257e967050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fe7320b8-b931-453c-a880-19896cc1f024+12:13765:x1875724578437632:12345-192.168.201.21@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788830715.146356:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257e967050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fe7320b8-b931-453c-a880-19896cc1f024+12:13765:x1875724578437632:12345-192.168.201.21@tcp:501:ll_cfg_requeue.0 Request processed in 298us (808us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830715.147023:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 115 00000100:00100000:2.0:1788830715.148665:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830715.148774:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578437760 00000100:00100000:0.0:1788830715.148784:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578437760 00000100:00100000:0.0:1788830715.148834:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 116 00000100:00100000:0.0:1788830715.148845:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257e964c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fe7320b8-b931-453c-a880-19896cc1f024+12:13765:x1875724578437760:12345-192.168.201.21@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788830715.149082:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257e964c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fe7320b8-b931-453c-a880-19896cc1f024+12:13765:x1875724578437760:12345-192.168.201.21@tcp:503:ll_cfg_requeue.0 Request processed in 238us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830715.149091:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 116 00000100:00100000:0.0:1788830715.158881:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830715.159251:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578437888 00000100:00100000:2.0:1788830715.159262:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578437888 00000100:00100000:2.0:1788830715.159453:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 117 00000100:00100000:2.0:1788830715.159465:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257e966050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fe7320b8-b931-453c-a880-19896cc1f024+12:13765:x1875724578437888:12345-192.168.201.21@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788830715.159483:0:14457:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788830715.159502:0:14457:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2565729800/0x575506951eea1f4e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa578910534662143 expref: -99 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830715.159529:0:14457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2565729800/0x575506951eea1f4e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534662143 expref: 13 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830715.159540:0:14457:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2565729800/0x575506951eea1f4e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534662143 expref: 13 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830715.159549:0:14457:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2565729800, rc 0) 00000100:00100000:2.0:1788830715.159611:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257e966050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fe7320b8-b931-453c-a880-19896cc1f024+13:13765:x1875724578437888:12345-192.168.201.21@tcp:101:ll_cfg_requeue.0 Request processed in 149us (740us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830715.159618:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 117 00000100:00100000:1.0:1788830715.163766:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830715.163952:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578438016 00000100:00100000:2.0:1788830715.163963:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578438016 00000100:00100000:2.0:1788830715.164021:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 118 00000100:00100000:2.0:1788830715.164032:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257e965450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fe7320b8-b931-453c-a880-19896cc1f024+13:13765:x1875724578438016:12345-192.168.201.21@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788830715.165093:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257e965450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fe7320b8-b931-453c-a880-19896cc1f024+13:13765:x1875724578438016:12345-192.168.201.21@tcp:501:ll_cfg_requeue.0 Request processed in 1059us (1390us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830715.165674:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 118 00000100:00100000:0.0:1788830715.168862:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830715.168968:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578438144 00000100:00100000:2.0:1788830715.168992:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578438144 00000100:00100000:2.0:1788830715.169045:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 119 00000100:00100000:2.0:1788830715.169055:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25519b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fe7320b8-b931-453c-a880-19896cc1f024+13:13765:x1875724578438144:12345-192.168.201.21@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788830715.169818:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25519b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fe7320b8-b931-453c-a880-19896cc1f024+13:13765:x1875724578438144:12345-192.168.201.21@tcp:503:ll_cfg_requeue.0 Request processed in 761us (961us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830715.169829:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 119 00010000:00010000:2.0:1788830715.612109:0:15935:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788830716.637162:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788830716.725388:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830716.725539:0:16335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578438272 00000100:00100000:2.0:1788830716.725551:0:16335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578438272 00000100:00100000:2.0:1788830716.725672:0:16335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 15 00000100:00100000:2.0:1788830716.725682:0:16335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25478b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d08645c-98b4-449f-9d92-4c318beec94d+6:14418:x1875724578438272:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788830716.725702:0:16335:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788830716.725753:0:16335:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728400/0x575506951eea1f55 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa57891053466214a expref: -99 pid: 16335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830716.725836:0:16335:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729000/0x575506951eea1f5c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830716.725851:0:16335:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729000/0x575506951eea1f5c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830716.725865:0:16335:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729000/0x575506951eea1f5c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830716.725879:0:16335:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728800/0x575506951eea1f63 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830716.725887:0:16335:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728800/0x575506951eea1f63 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830716.725923:0:16335:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728800/0x575506951eea1f63 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830716.726443:0:16335:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729e00/0x575506951eea1f6a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830716.726453:0:16335:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729e00/0x575506951eea1f6a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830716.726461:0:16335:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729e00/0x575506951eea1f6a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16335 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788830716.726484:0:16335:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788830716.726488:0:16335:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788830716.726525:0:16335:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729e00/0x575506951eea1f6a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830716.726536:0:16335:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729000/0x575506951eea1f5c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830716.726542:0:16335:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729000/0x575506951eea1f5c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830716.726550:0:16335:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729000/0x575506951eea1f5c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830716.726556:0:16335:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2565729000 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:2.0:1788830716.726561:0:16335:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729000/0x575506951eea1f5c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830716.726569:0:16335:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729000/0x575506951eea1f5c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830716.726588:0:16335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e257480c100) 00010000:00010000:2.0:1788830716.726596:0:16335:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788830716.726602:0:16335:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729000/0x575506951eea1f5c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830716.726608:0:16335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729000/0x575506951eea1f5c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830716.726622:0:16335:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728800/0x575506951eea1f63 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830716.726628:0:16335:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728800/0x575506951eea1f63 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830716.726633:0:16335:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728800/0x575506951eea1f63 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830716.726638:0:16335:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2565728800 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:2.0:1788830716.726641:0:16335:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728800/0x575506951eea1f63 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830716.726647:0:16335:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728800/0x575506951eea1f63 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830716.726655:0:16335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9e2551f3e000) 00010000:00010000:2.0:1788830716.726658:0:16335:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788830716.726661:0:16335:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728800/0x575506951eea1f63 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830716.726666:0:16335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728800/0x575506951eea1f63 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830716.726874:0:16335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728400/0x575506951eea1f55 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0xa57891053466214a expref: 8 pid: 16335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830716.726890:0:16335:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729e00/0x575506951eea1f6a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0xa57891053466214a expref: 7 pid: 16335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830716.726898:0:16335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9e2551f3e700) 00010000:00010000:2.0:1788830716.726900:0:16335:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788830716.726903:0:16335:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2565729e00, rc 0) 00000100:00100000:2.0:1788830716.727392:0:16335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25478b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d08645c-98b4-449f-9d92-4c318beec94d+7:14418:x1875724578438272:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 Request processed in 1708us (2195us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830716.727403:0:16335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 15 00000100:00080000:3.0:1788830716.728392:0:14459:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788830716.731747:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830716.731800:0:14465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578438528 00000100:00100000:0.0:1788830716.731812:0:14465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578438528 00000100:00100000:0.0:1788830716.731931:0:14465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 16 00000100:00100000:0.0:1788830716.731942:0:14465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25747c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d08645c-98b4-449f-9d92-4c318beec94d+7:14418:x1875724578438528:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788830716.731962:0:14465:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788830716.731984:0:14465:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6600/0x575506951eea1f71 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa578910534662151 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830716.732069:0:14465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6000/0x575506951eea1f78 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830716.732084:0:14465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6000/0x575506951eea1f78 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830716.732095:0:14465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6000/0x575506951eea1f78 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830716.732162:0:14465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7200/0x575506951eea1f7f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830716.732170:0:14465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7200/0x575506951eea1f7f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830716.732176:0:14465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7200/0x575506951eea1f7f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830716.732835:0:14465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7c00/0x575506951eea1f86 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830716.732848:0:14465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7c00/0x575506951eea1f86 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830716.732856:0:14465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7c00/0x575506951eea1f86 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788830716.732865:0:14465:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:0.0:1788830716.733480:0:14465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6000/0x575506951eea1f78 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830716.733487:0:14465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6000/0x575506951eea1f78 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830716.733493:0:14465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6000/0x575506951eea1f78 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830716.733499:0:14465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e25658d6000 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:0.0:1788830716.733503:0:14465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6000/0x575506951eea1f78 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830716.733520:0:14465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6000/0x575506951eea1f78 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830716.733534:0:14465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9e2551f3e700) 00010000:00010000:0.0:1788830716.733538:0:14465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788830716.733542:0:14465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6000/0x575506951eea1f78 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830716.733546:0:14465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6000/0x575506951eea1f78 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830716.733556:0:14465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7200/0x575506951eea1f7f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830716.733560:0:14465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7200/0x575506951eea1f7f lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830716.733564:0:14465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7200/0x575506951eea1f7f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830716.733567:0:14465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e25658d7200 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:0.0:1788830716.733568:0:14465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7200/0x575506951eea1f7f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830716.733572:0:14465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7200/0x575506951eea1f7f lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830716.733576:0:14465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9e2549d42800) 00010000:00010000:0.0:1788830716.733577:0:14465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788830716.733578:0:14465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7200/0x575506951eea1f7f lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830716.733588:0:14465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7200/0x575506951eea1f7f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830716.734419:0:14465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6600/0x575506951eea1f71 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534662151 expref: 10 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830716.734433:0:14465:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7c00/0x575506951eea1f86 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0xa578910534662151 expref: 9 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830716.734439:0:14465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e2549d42a00) 00010000:00010000:0.0:1788830716.734440:0:14465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788830716.734442:0:14465:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e25658d7c00, rc 0) 00000100:00100000:0.0:1788830716.734501:0:14465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25747c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d08645c-98b4-449f-9d92-4c318beec94d+9:14418:x1875724578438528:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 Request processed in 2560us (2765us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1788830716.734509:0:14465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 16 00000100:00100000:1.0:1788830716.744214:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830716.744447:0:14463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578438656 00000100:00100000:0.0:1788830716.744457:0:14463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578438656 00000100:00100000:0.0:1788830716.744517:0:14463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 17 00000100:00100000:0.0:1788830716.744527:0:14463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25747c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d08645c-98b4-449f-9d92-4c318beec94d+9:14418:x1875724578438656:12345-192.168.201.21@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1788830716.744633:0:14463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25747c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d08645c-98b4-449f-9d92-4c318beec94d+9:14418:x1875724578438656:12345-192.168.201.21@tcp:59:lhsmtool_posix.0 Request processed in 106us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830716.744641:0:14463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 17 00000100:00100000:3.0:1788830716.778425:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830716.778571:0:14464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578438784 00000100:00100000:1.0:1788830716.778580:0:14464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578438784 00000100:00100000:1.0:1788830716.778700:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 18 00000100:00100000:1.0:1788830716.778737:0:14464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257f733100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d08645c-98b4-449f-9d92-4c318beec94d+9:14424:x1875724578438784:12345-192.168.201.21@tcp:101:lfs.0 00010000:00010000:1.0:1788830716.778756:0:14464:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788830716.778777:0:14464:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffe00/0x575506951eea1f94 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa578910534662158 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830716.778839:0:14464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea1f9b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830716.778853:0:14464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea1f9b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830716.778864:0:14464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea1f9b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830716.778893:0:14464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fee00/0x575506951eea1fa2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830716.778901:0:14464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fee00/0x575506951eea1fa2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830716.778919:0:14464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fee00/0x575506951eea1fa2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830716.779114:0:14464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea1f9b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830716.779122:0:14464:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea1f9b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830716.779129:0:14464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea1f9b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830716.779134:0:14464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e25820fe400 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:1.0:1788830716.779138:0:14464:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea1f9b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830716.779145:0:14464:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea1f9b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830716.779156:0:14464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e257480c100) 00010000:00010000:1.0:1788830716.779159:0:14464:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788830716.779163:0:14464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea1f9b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830716.779169:0:14464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea1f9b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830716.779187:0:14464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fee00/0x575506951eea1fa2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830716.779193:0:14464:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fee00/0x575506951eea1fa2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830716.779199:0:14464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fee00/0x575506951eea1fa2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830716.779205:0:14464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e25820fee00 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:1.0:1788830716.779208:0:14464:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fee00/0x575506951eea1fa2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830716.779214:0:14464:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fee00/0x575506951eea1fa2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830716.779222:0:14464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9e257480c400) 00010000:00010000:1.0:1788830716.779225:0:14464:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788830716.779227:0:14464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fee00/0x575506951eea1fa2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830716.779232:0:14464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fee00/0x575506951eea1fa2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830716.779271:0:14464:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffe00/0x575506951eea1f94 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534662158 expref: 10 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830716.779283:0:14464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e257480c100) 00010000:00010000:1.0:1788830716.779286:0:14464:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788830716.779296:0:14464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffe00/0x575506951eea1f94 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.21@tcp remote: 0xa578910534662158 expref: 10 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830716.779305:0:14464:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e25820ffe00, rc 0) 00000100:00100000:1.0:1788830716.779373:0:14464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257f733100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d08645c-98b4-449f-9d92-4c318beec94d+9:14424:x1875724578438784:12345-192.168.201.21@tcp:101:lfs.0 Request processed in 663us (955us total) trans 0 rc 301/301 00000100:00100000:1.0:1788830716.779380:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 18 00000100:00100000:1.0:1788830716.792470:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830716.792591:0:14472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578438912 00000100:00100000:3.0:1788830716.792600:0:14472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578438912 00000100:00100000:3.0:1788830716.792682:0:14472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 0 00000100:00100000:3.0:1788830716.792693:0:14472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25747c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:5d08645c-98b4-449f-9d92-4c318beec94d+9:14424:x1875724578438912:12345-192.168.201.21@tcp:700:lfs.0 00000100:00100000:3.0:1788830716.792806:0:14472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25747c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:5d08645c-98b4-449f-9d92-4c318beec94d+9:14424:x1875724578438912:12345-192.168.201.21@tcp:700:lfs.0 Request processed in 115us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830716.792814:0:14472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 0 00000100:00100000:2.0:1788830716.797358:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830716.797505:0:14463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578439168 00000100:00100000:0.0:1788830716.797515:0:14463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578439168 00000100:00100000:0.0:1788830716.797601:0:14463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 19 00000100:00100000:0.0:1788830716.797612:0:14463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257f726300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d08645c-98b4-449f-9d92-4c318beec94d+9:14424:x1875724578439168:12345-192.168.201.21@tcp:36:lfs.0 00010000:00010000:0.0:1788830716.797680:0:14463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788830716.797704:0:14463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe800/0x575506951eea1ed7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.21@tcp remote: 0xa5789105346620d3 expref: 9 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830716.797742:0:14463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e257480c100) 00010000:00010000:0.0:1788830716.797745:0:14463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788830716.797947:0:14463:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7200/0x575506951eea1fa9 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830716.797962:0:14463:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea1f0f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0xa578910534662135 expref: 5 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830716.797970:0:14463:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7200/0x575506951eea1fa9 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830716.798003:0:14463:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea1f0f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.21@tcp remote: 0xa578910534662135 expref: 5 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830716.798018:0:14463:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea1f0f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.21@tcp remote: 0xa578910534662135 expref: 5 pid: 14463 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788830716.798029:0:14463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25478b7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14463:1875724595205504:192.168.201.21@tcp:104: 00000100:00100000:0.0:1788830716.798210:0:14463:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e254294f180 going to sleep for 11 seconds 00000100:00100000:3.0:1788830716.800662:0:14463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25478b7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14463:1875724595205504:192.168.201.21@tcp:104: 00010000:00010000:3.0:1788830716.800692:0:14463:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7200/0x575506951eea1fa9 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14463 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788830716.801300:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830716.801578:0:14448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578439296 00000100:00100000:1.0:1788830716.801586:0:14448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578439296 00010000:00010000:1.0:1788830716.801636:0:14448:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea1f0f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.21@tcp remote: 0xa578910534662135 expref: 6 pid: 14463 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788830716.801653:0:14459:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788830716.801674:0:14448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 9 00000100:00100000:1.0:1788830716.801683:0:14448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257f724e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ade59d61-740e-497b-bdec-03aa0b1957da+6:2354:x1875724578439296:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788830716.801698:0:14448:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788830716.801706:0:14448:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea1f0f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.21@tcp remote: 0xa578910534662135 expref: 6 pid: 14463 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830716.801840:0:14448:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea1f0f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.21@tcp remote: 0xa578910534662135 expref: 6 pid: 14463 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830716.801862:0:14448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea1f0f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.21@tcp remote: 0xa578910534662135 expref: 6 pid: 14463 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830716.801877:0:14448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e257480c100) 00010000:00010000:1.0:1788830716.802024:0:14448:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7200/0x575506951eea1fa9 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830716.802063:0:14448:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7200/0x575506951eea1fa9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830716.802069:0:14448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7200/0x575506951eea1fa9 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830716.802092:0:14448:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788830716.802120:0:14463:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7200/0x575506951eea1fa9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830716.802128:0:14463:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7200/0x575506951eea1fa9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830716.802154:0:14463:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445f8f400/0x575506951eea1fb0 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830716.802174:0:14463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445f8f400/0x575506951eea1fb0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830716.802184:0:14463:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445f8f400/0x575506951eea1fb0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14463 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788830716.802622:0:14448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257f724e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ade59d61-740e-497b-bdec-03aa0b1957da+5:2354:x1875724578439296:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 937us (1327us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830716.802631:0:14448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 9 00000004:00200000:3.0:1788830716.803502:0:14463:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788830716.803514:0:14463:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7200/0x575506951eea1fa9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830716.803521:0:14463:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7200/0x575506951eea1fa9 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830716.803528:0:14463:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7200/0x575506951eea1fa9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830716.803534:0:14463:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e25658d7200 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:3.0:1788830716.803539:0:14463:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7200/0x575506951eea1fa9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830716.803546:0:14463:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7200/0x575506951eea1fa9 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830716.803559:0:14463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e257480c100) 00010000:00010000:3.0:1788830716.803561:0:14463:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788830716.803565:0:14463:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7200/0x575506951eea1fa9 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830716.803571:0:14463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7200/0x575506951eea1fa9 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14463 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788830716.803599:0:14463:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000045a49392 reply state 00000000a8eb03a4 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445f8f400/0x575506951eea1fb0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14463 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788830716.803607:0:14463:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788830716.803675:0:14463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257f726300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d08645c-98b4-449f-9d92-4c318beec94d+10:14424:x1875724578439168:12345-192.168.201.21@tcp:36:lfs.0 Request processed in 6063us (6323us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1788830716.803682:0:14463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 19 00010000:00010000:1.0:1788830716.807224:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445f8f400/0x575506951eea1fb0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830716.807242:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445f8f400/0x575506951eea1fb0 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830716.807250:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445f8f400/0x575506951eea1fb0 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830716.807256:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2445f8f400 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:1.0:1788830716.807261:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445f8f400/0x575506951eea1fb0 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830716.807269:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445f8f400/0x575506951eea1fb0 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830716.807286:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9e2559bf1b00) 00010000:00010000:1.0:1788830716.807290:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788830716.807294:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445f8f400/0x575506951eea1fb0 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830716.807319:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445f8f400/0x575506951eea1fb0 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14463 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788830716.879923:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830716.880179:0:14465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578439424 00000100:00100000:0.0:1788830716.880191:0:14465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578439424 00000100:00100000:0.0:1788830716.880325:0:14465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 20 00000100:00100000:0.0:1788830716.880337:0:14465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257f724000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d08645c-98b4-449f-9d92-4c318beec94d+9:14432:x1875724578439424:12345-192.168.201.21@tcp:101:lctl.0 00010000:00010000:0.0:1788830716.880362:0:14465:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788830716.880400:0:14465:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6000/0x575506951eea1fb7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa57891053466215f expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830716.880467:0:14465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6200/0x575506951eea1fbe lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830716.880481:0:14465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6200/0x575506951eea1fbe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830716.880495:0:14465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6200/0x575506951eea1fbe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788830716.880530:0:14465:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788830716.880533:0:14465:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788830716.880571:0:14465:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6200/0x575506951eea1fbe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830716.880594:0:14465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6000/0x575506951eea1fb7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0xa57891053466215f expref: 11 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830716.880612:0:14465:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6200/0x575506951eea1fbe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0xa57891053466215f expref: 10 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830716.880620:0:14465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2549d42800) 00010000:00010000:0.0:1788830716.880623:0:14465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788830716.880627:0:14465:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e25658d6200, rc 0) 00000100:00100000:0.0:1788830716.880693:0:14465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257f724000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d08645c-98b4-449f-9d92-4c318beec94d+10:14432:x1875724578439424:12345-192.168.201.21@tcp:101:lctl.0 Request processed in 354us (775us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830716.880702:0:14465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 20 00000100:00100000:0.0:1788830716.922420:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830716.922504:0:16335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578439552 00000100:00100000:2.0:1788830716.922515:0:16335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578439552 00000100:00100000:2.0:1788830716.922591:0:16335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 21 00000100:00100000:2.0:1788830716.922602:0:16335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25478b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ade59d61-740e-497b-bdec-03aa0b1957da+5:14433:x1875724578439552:12345-192.168.201.21@tcp:101:lfs.0 00010000:00010000:2.0:1788830716.922623:0:16335:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788830716.922644:0:16335:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729000/0x575506951eea1fc5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa578910534662166 expref: -99 pid: 16335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830716.922748:0:16335:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728800/0x575506951eea1fcc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830716.922761:0:16335:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728800/0x575506951eea1fcc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830716.922780:0:16335:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728800/0x575506951eea1fcc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16335 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788830716.922815:0:16335:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788830716.922819:0:16335:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788830716.922839:0:16335:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728800/0x575506951eea1fcc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830716.922863:0:16335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729000/0x575506951eea1fc5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534662166 expref: 7 pid: 16335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830716.922881:0:16335:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728800/0x575506951eea1fcc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0xa578910534662166 expref: 6 pid: 16335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830716.922889:0:16335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2549d42800) 00010000:00010000:2.0:1788830716.922891:0:16335:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788830716.922896:0:16335:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2565728800, rc 0) 00000100:00100000:2.0:1788830716.923162:0:16335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25478b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ade59d61-740e-497b-bdec-03aa0b1957da+6:14433:x1875724578439552:12345-192.168.201.21@tcp:101:lfs.0 Request processed in 560us (750us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830716.923170:0:16335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 21 00000100:00100000:2.0:1788830716.937948:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830716.938148:0:14464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578439680 00000100:00100000:1.0:1788830716.938158:0:14464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578439680 00000100:00100000:1.0:1788830716.938219:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 22 00000100:00100000:1.0:1788830716.938229:0:14464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257f724380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ade59d61-740e-497b-bdec-03aa0b1957da+6:14433:x1875724578439680:12345-192.168.201.21@tcp:101:lfs.0 00010000:00010000:1.0:1788830716.938259:0:14464:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788830716.938278:0:14464:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fee00/0x575506951eea1fd3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa57891053466216d expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830716.938343:0:14464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea1fda lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830716.938358:0:14464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea1fda lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830716.938369:0:14464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea1fda lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830716.938383:0:14464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fea00/0x575506951eea1fe1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830716.938390:0:14464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fea00/0x575506951eea1fe1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830716.938396:0:14464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fea00/0x575506951eea1fe1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830716.938484:0:14464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffc00/0x575506951eea1fe8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830716.938501:0:14464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffc00/0x575506951eea1fe8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830716.938509:0:14464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffc00/0x575506951eea1fe8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788830716.938540:0:14464:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788830716.938543:0:14464:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788830716.938686:0:14464:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffc00/0x575506951eea1fe8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830716.938701:0:14464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea1fda lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830716.938707:0:14464:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea1fda lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830716.938864:0:14464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea1fda lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830716.938869:0:14464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e25820fe400 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:1.0:1788830716.938873:0:14464:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea1fda lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830716.938881:0:14464:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea1fda lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830716.938894:0:14464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2549d42800) 00010000:00010000:1.0:1788830716.938896:0:14464:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788830716.938901:0:14464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea1fda lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830716.939057:0:14464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe400/0x575506951eea1fda lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830716.939071:0:14464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fea00/0x575506951eea1fe1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830716.939076:0:14464:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fea00/0x575506951eea1fe1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830716.939082:0:14464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fea00/0x575506951eea1fe1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830716.939087:0:14464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e25820fea00 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:1.0:1788830716.939090:0:14464:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fea00/0x575506951eea1fe1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830716.939149:0:14464:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fea00/0x575506951eea1fe1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830716.939160:0:14464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9e257480c400) 00010000:00010000:1.0:1788830716.939162:0:14464:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788830716.939165:0:14464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fea00/0x575506951eea1fe1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830716.939170:0:14464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fea00/0x575506951eea1fe1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830716.939201:0:14464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fee00/0x575506951eea1fd3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0xa57891053466216d expref: 8 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830716.939225:0:14464:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffc00/0x575506951eea1fe8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0xa57891053466216d expref: 7 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830716.939232:0:14464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9e257480c000) 00010000:00010000:1.0:1788830716.939234:0:14464:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788830716.939237:0:14464:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e25820ffc00, rc 0) 00000100:00100000:1.0:1788830716.939504:0:14464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257f724380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ade59d61-740e-497b-bdec-03aa0b1957da+7:14433:x1875724578439680:12345-192.168.201.21@tcp:101:lfs.0 Request processed in 1275us (1563us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830716.939514:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 22 00000100:00100000:1.0:1788830716.953351:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830716.953451:0:16335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578439936 00000100:00100000:2.0:1788830716.953461:0:16335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578439936 00000100:00100000:2.0:1788830716.953521:0:16335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 23 00000100:00100000:2.0:1788830716.953532:0:16335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25747c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ade59d61-740e-497b-bdec-03aa0b1957da+7:14433:x1875724578439936:12345-192.168.201.21@tcp:101:lfs.0 00010000:00010000:2.0:1788830716.953553:0:16335:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788830716.953572:0:16335:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729000/0x575506951eea1fef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa578910534662174 expref: -99 pid: 16335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788830716.953682:0:16335:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788830716.953858:0:16335:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729000/0x575506951eea1fef lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534662174 expref: 9 pid: 16335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830716.953872:0:16335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2549d42800) 00010000:00010000:2.0:1788830716.953876:0:16335:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788830716.953880:0:16335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729000/0x575506951eea1fef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.21@tcp remote: 0xa578910534662174 expref: 9 pid: 16335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830716.953894:0:16335:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2565729000, rc 0) 00000100:00100000:2.0:1788830716.954136:0:16335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25747c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ade59d61-740e-497b-bdec-03aa0b1957da+8:14433:x1875724578439936:12345-192.168.201.21@tcp:101:lfs.0 Request processed in 605us (793us total) trans 8589934595 rc 301/301 00000100:00100000:2.0:1788830716.954144:0:16335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 23 00000040:00080000:2.0:1788830716.956598:0:14495:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788830716.957600:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830716.957702:0:14464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578440192 00000100:00100000:1.0:1788830716.957728:0:14464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578440192 00000100:00100000:1.0:1788830716.957788:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 24 00000100:00100000:1.0:1788830716.957800:0:14464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257f730380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ade59d61-740e-497b-bdec-03aa0b1957da+8:14433:x1875724578440192:12345-192.168.201.21@tcp:36:lfs.0 00010000:00010000:1.0:1788830716.957861:0:14464:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788830716.958150:0:14464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffc00/0x575506951eea1fe8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.21@tcp remote: 0xa57891053466216d expref: 8 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830716.958171:0:14464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9e257480c000) 00010000:00010000:1.0:1788830716.958182:0:14464:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788830716.958206:0:14464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fea00/0x575506951eea1ffd lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830716.958220:0:14464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fea00/0x575506951eea1ffd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830716.958230:0:14464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fea00/0x575506951eea1ffd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788830716.958448:0:14464:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f2c8573b reply state 00000000ef6d2267 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fea00/0x575506951eea1ffd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788830716.958458:0:14464:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788830716.958466:0:14464:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1788830716.958551:0:14464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257f730380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ade59d61-740e-497b-bdec-03aa0b1957da+9:14433:x1875724578440192:12345-192.168.201.21@tcp:36:lfs.0 Request processed in 754us (956us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1788830716.958558:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 24 00010000:00010000:2.0:1788830716.967327:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fea00/0x575506951eea1ffd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830716.967346:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fea00/0x575506951eea1ffd lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830716.967353:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fea00/0x575506951eea1ffd lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830716.967360:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e25820fea00 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:2.0:1788830716.967364:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fea00/0x575506951eea1ffd lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830716.967372:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fea00/0x575506951eea1ffd lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830716.967405:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9e257480c400) 00010000:00010000:2.0:1788830716.967408:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1788830716.967412:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fea00/0x575506951eea1ffd lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830716.967420:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fea00/0x575506951eea1ffd lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788830716.975871:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830716.975986:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578440448 00000100:00100000:3.0:1788830716.975995:0:14466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578440448 00000100:00100000:3.0:1788830716.976057:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 2 00000100:00100000:3.0:1788830716.976067:0:14466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25478b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ade59d61-740e-497b-bdec-03aa0b1957da+8:14433:x1875724578440448:12345-192.168.201.21@tcp:35:lfs.0 00000100:00100000:3.0:1788830716.976312:0:14466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25478b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ade59d61-740e-497b-bdec-03aa0b1957da+9:14433:x1875724578440448:12345-192.168.201.21@tcp:35:lfs.0 Request processed in 246us (753us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1788830716.976320:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 2 00000100:00100000:1.0:1788830716.983533:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830716.983751:0:16335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578440704 00000100:00100000:2.0:1788830716.983761:0:16335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578440704 00000100:00100000:2.0:1788830716.983826:0:16335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 25 00000100:00100000:2.0:1788830716.983836:0:16335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25747c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ade59d61-740e-497b-bdec-03aa0b1957da+9:14433:x1875724578440704:12345-192.168.201.21@tcp:101:lfs.0 00010000:00010000:2.0:1788830716.983860:0:16335:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788830716.983878:0:16335:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729000/0x575506951eea2004 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa57891053466217b expref: -99 pid: 16335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830716.983963:0:16335:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728400/0x575506951eea200b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830716.983978:0:16335:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728400/0x575506951eea200b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830716.983989:0:16335:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728400/0x575506951eea200b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830716.984006:0:16335:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8ce00/0x575506951eea2012 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830716.984012:0:16335:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8ce00/0x575506951eea2012 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830716.984049:0:16335:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8ce00/0x575506951eea2012 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16335 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788830716.984175:0:16335:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788830716.984264:0:16335:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728400/0x575506951eea200b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830716.984272:0:16335:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728400/0x575506951eea200b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830716.984279:0:16335:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728400/0x575506951eea200b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830716.984285:0:16335:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2565728400 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:2.0:1788830716.984289:0:16335:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728400/0x575506951eea200b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830716.984295:0:16335:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728400/0x575506951eea200b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830716.984307:0:16335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2549d42800) 00010000:00010000:2.0:1788830716.984310:0:16335:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788830716.984315:0:16335:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728400/0x575506951eea200b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830716.984322:0:16335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565728400/0x575506951eea200b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830716.984336:0:16335:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8ce00/0x575506951eea2012 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830716.984351:0:16335:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8ce00/0x575506951eea2012 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830716.984357:0:16335:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8ce00/0x575506951eea2012 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830716.984362:0:16335:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e257fa8ce00 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:2.0:1788830716.984364:0:16335:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8ce00/0x575506951eea2012 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830716.984369:0:16335:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8ce00/0x575506951eea2012 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830716.984377:0:16335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9e2551f3e000) 00010000:00010000:2.0:1788830716.984381:0:16335:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788830716.984385:0:16335:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8ce00/0x575506951eea2012 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830716.984390:0:16335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8ce00/0x575506951eea2012 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830716.984427:0:16335:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729000/0x575506951eea2004 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0xa57891053466217b expref: 11 pid: 16335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830716.984436:0:16335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2549d42800) 00010000:00010000:2.0:1788830716.984438:0:16335:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788830716.984441:0:16335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2565729000/0x575506951eea2004 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.21@tcp remote: 0xa57891053466217b expref: 11 pid: 16335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830716.984460:0:16335:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2565729000, rc 0) 00000100:00100000:2.0:1788830716.984514:0:16335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25747c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ade59d61-740e-497b-bdec-03aa0b1957da+10:14433:x1875724578440704:12345-192.168.201.21@tcp:101:lfs.0 Request processed in 678us (990us total) trans 8589934598 rc 301/301 00000100:00100000:2.0:1788830716.984521:0:16335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 25 00000100:00100000:1.0:1788830716.995998:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830716.996159:0:14465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578440832 00000100:00100000:2.0:1788830716.996170:0:14465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578440832 00000100:00100000:2.0:1788830716.996237:0:14465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 26 00000100:00100000:2.0:1788830716.996248:0:14465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25747c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ade59d61-740e-497b-bdec-03aa0b1957da+10:14433:x1875724578440832:12345-192.168.201.21@tcp:101:lfs.0 00010000:00010000:2.0:1788830716.996272:0:14465:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788830716.996292:0:14465:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8c000/0x575506951eea2020 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa578910534662182 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830716.996373:0:14465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8c800/0x575506951eea2027 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830716.996386:0:14465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8c800/0x575506951eea2027 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830716.996396:0:14465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8c800/0x575506951eea2027 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788830716.996419:0:14465:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788830716.996423:0:14465:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788830716.996439:0:14465:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8c800/0x575506951eea2027 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830716.996463:0:14465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8c000/0x575506951eea2020 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534662182 expref: 12 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830716.996500:0:14465:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8c800/0x575506951eea2027 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0xa578910534662182 expref: 11 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830716.996508:0:14465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9e2551f3e800) 00010000:00010000:2.0:1788830716.996511:0:14465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788830716.996513:0:14465:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e257fa8c800, rc 0) 00000100:00100000:2.0:1788830716.997153:0:14465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25747c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ade59d61-740e-497b-bdec-03aa0b1957da+11:14433:x1875724578440832:12345-192.168.201.21@tcp:101:lfs.0 Request processed in 902us (1163us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830716.997162:0:14465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 26 00000100:00100000:0.0:1788830717.001816:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830717.002022:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578440960 00000100:00100000:3.0:1788830717.002046:0:14466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578440960 00000100:00100000:3.0:1788830717.002117:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 3 00000100:00100000:3.0:1788830717.002129:0:14466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25478b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ade59d61-740e-497b-bdec-03aa0b1957da+11:14433:x1875724578440960:12345-192.168.201.21@tcp:37:lfs.0 00000100:00100000:1.0:1788830717.009653:0:14466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25478b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ade59d61-740e-497b-bdec-03aa0b1957da+11:14433:x1875724578440960:12345-192.168.201.21@tcp:37:lfs.0 Request processed in 7514us (7834us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830717.009668:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 3 00000100:00100000:1.0:1788830717.014277:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830717.014383:0:14467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578441216 00000100:00100000:2.0:1788830717.014394:0:14467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578441216 00000100:00100000:2.0:1788830717.014491:0:14467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 4 00000100:00100000:2.0:1788830717.014502:0:14467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e244532c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ade59d61-740e-497b-bdec-03aa0b1957da+11:14433:x1875724578441216:12345-192.168.201.21@tcp:35:lfs.0 00000100:00100000:2.0:1788830717.014785:0:14467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e244532c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ade59d61-740e-497b-bdec-03aa0b1957da+12:14433:x1875724578441216:12345-192.168.201.21@tcp:35:lfs.0 Request processed in 284us (514us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1788830717.014794:0:14467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 4 00000100:00100000:0.0:1788830717.062086:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830717.062190:0:16335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578441344 00000100:00100000:2.0:1788830717.062200:0:16335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578441344 00000100:00100000:2.0:1788830717.062261:0:16335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 27 00000100:00100000:2.0:1788830717.062272:0:16335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25478b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d08645c-98b4-449f-9d92-4c318beec94d+10:14439:x1875724578441344:12345-192.168.201.21@tcp:101:bash.0 00010000:00010000:2.0:1788830717.062302:0:16335:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788830717.062321:0:16335:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8c000/0x575506951eea202e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa578910534662189 expref: -99 pid: 16335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830717.062379:0:16335:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8ce00/0x575506951eea2035 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830717.062401:0:16335:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8ce00/0x575506951eea2035 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830717.062412:0:16335:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8ce00/0x575506951eea2035 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830717.062428:0:16335:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8d800/0x575506951eea203c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830717.062435:0:16335:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8d800/0x575506951eea203c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830717.062441:0:16335:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8d800/0x575506951eea203c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830717.062534:0:16335:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8d400/0x575506951eea2043 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830717.062542:0:16335:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8d400/0x575506951eea2043 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830717.062550:0:16335:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8d400/0x575506951eea2043 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16335 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788830717.062575:0:16335:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788830717.062578:0:16335:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788830717.062614:0:16335:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8d400/0x575506951eea2043 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830717.062625:0:16335:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8ce00/0x575506951eea2035 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830717.062639:0:16335:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8ce00/0x575506951eea2035 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830717.062645:0:16335:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8ce00/0x575506951eea2035 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830717.062650:0:16335:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e257fa8ce00 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:2.0:1788830717.062654:0:16335:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8ce00/0x575506951eea2035 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830717.062661:0:16335:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8ce00/0x575506951eea2035 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830717.062672:0:16335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2549d42800) 00010000:00010000:2.0:1788830717.062675:0:16335:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788830717.062679:0:16335:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8ce00/0x575506951eea2035 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830717.062685:0:16335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8ce00/0x575506951eea2035 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830717.062700:0:16335:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8d800/0x575506951eea203c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830717.062705:0:16335:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8d800/0x575506951eea203c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830717.062761:0:16335:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8d800/0x575506951eea203c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830717.062766:0:16335:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e257fa8d800 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:2.0:1788830717.062774:0:16335:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8d800/0x575506951eea203c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830717.062781:0:16335:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8d800/0x575506951eea203c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830717.062788:0:16335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9e2551f3e000) 00010000:00010000:2.0:1788830717.062791:0:16335:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788830717.062794:0:16335:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8d800/0x575506951eea203c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830717.062799:0:16335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8d800/0x575506951eea203c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830717.062828:0:16335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8c000/0x575506951eea202e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534662189 expref: 12 pid: 16335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830717.062841:0:16335:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8d400/0x575506951eea2043 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0xa578910534662189 expref: 11 pid: 16335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830717.062848:0:16335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9e2551f3e800) 00010000:00010000:2.0:1788830717.062850:0:16335:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788830717.062852:0:16335:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e257fa8d400, rc 0) 00000100:00100000:2.0:1788830717.063242:0:16335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25478b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d08645c-98b4-449f-9d92-4c318beec94d+11:14439:x1875724578441344:12345-192.168.201.21@tcp:101:bash.0 Request processed in 971us (1165us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830717.063251:0:16335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 27 00000100:00100000:3.0:1788830717.068126:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830717.068348:0:14464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578441600 00000100:00100000:1.0:1788830717.068359:0:14464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578441600 00000100:00100000:1.0:1788830717.068422:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 28 00000100:00100000:1.0:1788830717.068432:0:14464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257f732300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d08645c-98b4-449f-9d92-4c318beec94d+11:14439:x1875724578441600:12345-192.168.201.21@tcp:101:bash.0 00010000:00010000:1.0:1788830717.068451:0:14464:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788830717.068470:0:14464:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffc00/0x575506951eea204a lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa578910534662190 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830717.068582:0:14464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fea00/0x575506951eea2051 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830717.068596:0:14464:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8c800/0x575506951eea2027 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0xa578910534662182 expref: 11 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830717.068621:0:14464:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fea00/0x575506951eea2051 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830717.068653:0:14464:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8c800/0x575506951eea2027 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.21@tcp remote: 0xa578910534662182 expref: 11 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830717.068666:0:14464:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8c800/0x575506951eea2027 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.21@tcp remote: 0xa578910534662182 expref: 11 pid: 14465 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788830717.068679:0:14464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25747c3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14464:1875724595205632:192.168.201.21@tcp:104: 00000100:00100000:1.0:1788830717.068805:0:14464:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2553723d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788830717.077875:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830717.078274:0:14464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25747c3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14464:1875724595205632:192.168.201.21@tcp:104: 00010000:00010000:2.0:1788830717.078305:0:14464:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fea00/0x575506951eea2051 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788830717.079238:0:14450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578441728 00000100:00100000:0.0:1788830717.079249:0:14450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578441728 00010000:00010000:0.0:1788830717.079527:0:14450:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8c800/0x575506951eea2027 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.21@tcp remote: 0xa578910534662182 expref: 12 pid: 14465 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788830717.079632:0:14450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 10 00000100:00100000:0.0:1788830717.079644:0:14450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25747c2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ade59d61-740e-497b-bdec-03aa0b1957da+12:2355:x1875724578441728:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788830717.079658:0:14450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788830717.079665:0:14450:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8c800/0x575506951eea2027 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.21@tcp remote: 0xa578910534662182 expref: 12 pid: 14465 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830717.079678:0:14450:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8c800/0x575506951eea2027 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.21@tcp remote: 0xa578910534662182 expref: 12 pid: 14465 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830717.079699:0:14450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8c800/0x575506951eea2027 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.21@tcp remote: 0xa578910534662182 expref: 12 pid: 14465 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830717.079755:0:14450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9e2551f3e800) 00010000:00010000:0.0:1788830717.079761:0:14450:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fea00/0x575506951eea2051 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830717.079771:0:14450:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fea00/0x575506951eea2051 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830717.079778:0:14450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fea00/0x575506951eea2051 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830717.079815:0:14450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788830717.079875:0:14450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25747c2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ade59d61-740e-497b-bdec-03aa0b1957da+11:2355:x1875724578441728:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 234us (2009us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830717.079883:0:14450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 10 00010000:00010000:1.0:1788830717.080177:0:14464:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fea00/0x575506951eea2051 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830717.080186:0:14464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fea00/0x575506951eea2051 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830717.080251:0:14464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fee00/0x575506951eea2058 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830717.080262:0:14464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fee00/0x575506951eea2058 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830717.080271:0:14464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fee00/0x575506951eea2058 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830717.080953:0:14464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea205f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830717.080968:0:14464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea205f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830717.080976:0:14464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea205f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788830717.080985:0:14464:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788830717.081010:0:14464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fea00/0x575506951eea2051 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830717.081016:0:14464:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fea00/0x575506951eea2051 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830717.081023:0:14464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fea00/0x575506951eea2051 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830717.081029:0:14464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e25820fea00 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:1.0:1788830717.081044:0:14464:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fea00/0x575506951eea2051 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830717.081051:0:14464:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fea00/0x575506951eea2051 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830717.081061:0:14464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9e2551f3e800) 00010000:00010000:1.0:1788830717.081064:0:14464:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788830717.081068:0:14464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fea00/0x575506951eea2051 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830717.081074:0:14464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fea00/0x575506951eea2051 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788830717.081085:0:14464:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000647c2601 reply state 00000000c6148085 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fee00/0x575506951eea2058 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788830717.081099:0:14464:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788830717.081132:0:14464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffc00/0x575506951eea204a lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534662190 expref: 14 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830717.081145:0:14464:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea205f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0xa578910534662190 expref: 13 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830717.081153:0:14464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e257480c400) 00010000:00010000:1.0:1788830717.081155:0:14464:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1788830717.081157:0:14464:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e25820ff800, rc 0) 00000100:00100000:1.0:1788830717.081219:0:14464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257f732300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d08645c-98b4-449f-9d92-4c318beec94d+14:14439:x1875724578441600:12345-192.168.201.21@tcp:101:bash.0 Request processed in 12788us (13101us total) trans 8589934600 rc 0/0 00000100:00100000:1.0:1788830717.081226:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 28 00010000:00010000:3.0:1788830717.083507:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fee00/0x575506951eea2058 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830717.083526:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fee00/0x575506951eea2058 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830717.083534:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fee00/0x575506951eea2058 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830717.083554:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e25820fee00 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:3.0:1788830717.083559:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fee00/0x575506951eea2058 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830717.083567:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fee00/0x575506951eea2058 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830717.083582:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9e257480c000) 00010000:00010000:3.0:1788830717.083585:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788830717.083590:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fee00/0x575506951eea2058 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830717.083596:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fee00/0x575506951eea2058 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788830717.096260:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830717.096524:0:16335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578441856 00000100:00100000:2.0:1788830717.096535:0:16335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578441856 00000100:00100000:2.0:1788830717.096595:0:16335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 29 00000100:00100000:2.0:1788830717.096605:0:16335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257f731c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d08645c-98b4-449f-9d92-4c318beec94d+13:14439:x1875724578441856:12345-192.168.201.21@tcp:101:bash.0 00010000:00010000:2.0:1788830717.096632:0:16335:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788830717.096650:0:16335:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8c000/0x575506951eea206d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa578910534662197 expref: -99 pid: 16335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830717.096764:0:16335:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8d800/0x575506951eea2074 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830717.096779:0:16335:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8d800/0x575506951eea2074 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830717.096790:0:16335:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8d800/0x575506951eea2074 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16335 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788830717.096830:0:16335:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788830717.096835:0:16335:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788830717.096854:0:16335:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8d800/0x575506951eea2074 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830717.096864:0:16335:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8d800/0x575506951eea2074 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830717.096890:0:16335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8c000/0x575506951eea206d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0xa578910534662197 expref: 15 pid: 16335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830717.097112:0:16335:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8d800/0x575506951eea2074 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0xa578910534662197 expref: 14 pid: 16335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830717.097135:0:16335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e257480c400) 00010000:00010000:2.0:1788830717.097138:0:16335:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788830717.097141:0:16335:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e257fa8d800, rc 0) 00000100:00100000:2.0:1788830717.097204:0:16335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257f731c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d08645c-98b4-449f-9d92-4c318beec94d+14:14439:x1875724578441856:12345-192.168.201.21@tcp:101:bash.0 Request processed in 600us (955us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830717.097212:0:16335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 29 00000100:00100000:1.0:1788830717.101562:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830717.101671:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578442112 00000100:00100000:3.0:1788830717.101682:0:14466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578442112 00000100:00100000:3.0:1788830717.102077:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 5 00000100:00100000:3.0:1788830717.102089:0:14466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25747c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5d08645c-98b4-449f-9d92-4c318beec94d+14:14439:x1875724578442112:12345-192.168.201.21@tcp:35:bash.0 00000100:00100000:3.0:1788830717.102432:0:14466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25747c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5d08645c-98b4-449f-9d92-4c318beec94d+15:14439:x1875724578442112:12345-192.168.201.21@tcp:35:bash.0 Request processed in 345us (880us total) trans 8589934601 rc 0/0 00000100:00100000:3.0:1788830717.102437:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 5 00000100:00100000:3.0:1788830717.184898:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830717.185110:0:14465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578442368 00000100:00100000:2.0:1788830717.185126:0:14465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578442368 00000100:00100000:2.0:1788830717.185254:0:14465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 30 00000100:00100000:2.0:1788830717.185265:0:14465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257f732680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d08645c-98b4-449f-9d92-4c318beec94d+15:14449:x1875724578442368:12345-192.168.201.21@tcp:101:lfs.0 00010000:00010000:2.0:1788830717.185292:0:14465:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788830717.185311:0:14465:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8c000/0x575506951eea207b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa57891053466219e expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788830717.185390:0:14465:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788830717.185485:0:14465:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8c000/0x575506951eea207b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0xa57891053466219e expref: 17 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830717.185496:0:14465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2549d42800) 00010000:00010000:2.0:1788830717.185498:0:14465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788830717.185502:0:14465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8c000/0x575506951eea207b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.21@tcp remote: 0xa57891053466219e expref: 17 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830717.185514:0:14465:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e257fa8c000, rc 0) 00000100:00100000:2.0:1788830717.185570:0:14465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257f732680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d08645c-98b4-449f-9d92-4c318beec94d+16:14449:x1875724578442368:12345-192.168.201.21@tcp:101:lfs.0 Request processed in 308us (683us total) trans 8589934602 rc 301/301 00000100:00100000:2.0:1788830717.185588:0:14465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 30 00000100:00100000:1.0:1788830717.189474:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830717.192238:0:14467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578442624 00000100:00100000:2.0:1788830717.192253:0:14467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578442624 00000100:00100000:2.0:1788830717.192314:0:14467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 6 00000100:00100000:2.0:1788830717.192324:0:14467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25747c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5d08645c-98b4-449f-9d92-4c318beec94d+16:14449:x1875724578442624:12345-192.168.201.21@tcp:35:lfs.0 00000100:00100000:2.0:1788830717.192537:0:14467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25747c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5d08645c-98b4-449f-9d92-4c318beec94d+17:14449:x1875724578442624:12345-192.168.201.21@tcp:35:lfs.0 Request processed in 213us (3071us total) trans 8589934603 rc 0/0 00000100:00100000:2.0:1788830717.192543:0:14467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 6 00000100:00100000:3.0:1788830717.231456:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830717.231609:0:14463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578442880 00000100:00100000:0.0:1788830717.231620:0:14463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578442880 00000100:00100000:0.0:1788830717.231681:0:14463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 31 00000100:00100000:0.0:1788830717.231691:0:14463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257f730e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d08645c-98b4-449f-9d92-4c318beec94d+17:14452:x1875724578442880:12345-192.168.201.21@tcp:101:lfs.0 00010000:00010000:0.0:1788830717.231750:0:14463:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788830717.231770:0:14463:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6000/0x575506951eea2089 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5789105346621a5 expref: -99 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830717.231867:0:14463:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7200/0x575506951eea2090 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830717.231881:0:14463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7200/0x575506951eea2090 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830717.231894:0:14463:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7200/0x575506951eea2090 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14463 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788830717.231905:0:14463:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788830717.232410:0:14463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6000/0x575506951eea2089 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0xa5789105346621a5 expref: 20 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830717.232430:0:14463:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7200/0x575506951eea2090 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0xa5789105346621a5 expref: 19 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830717.232455:0:14463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e257480c400) 00010000:00010000:0.0:1788830717.232458:0:14463:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788830717.232461:0:14463:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e25658d7200, rc 0) 00000100:00100000:0.0:1788830717.232568:0:14463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257f730e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d08645c-98b4-449f-9d92-4c318beec94d+19:14452:x1875724578442880:12345-192.168.201.21@tcp:101:lfs.0 Request processed in 878us (1121us total) trans 8589934604 rc 0/0 00000100:00100000:0.0:1788830717.232576:0:14463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 31 00000100:00100000:1.0:1788830717.244765:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830717.244825:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830717.245078:0:16577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578443136 00000100:00100000:3.0:1788830717.245088:0:16577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578443136 00000100:00100000:3.0:1788830717.245156:0:16577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 0 00000100:00100000:3.0:1788830717.245181:0:16577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25658df100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5d08645c-98b4-449f-9d92-4c318beec94d+19:2353:x1875724578443136:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788830717.245196:0:16577:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788830717.245219:0:16577:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7200/0x575506951eea2090 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.21@tcp remote: 0xa5789105346621a5 expref: 19 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830717.245239:0:16577:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e257480c400) 00010000:00010000:3.0:1788830717.245244:0:16577:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788830717.245307:0:16577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25658df100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5d08645c-98b4-449f-9d92-4c318beec94d+18:2353:x1875724578443136:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 128us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830717.245314:0:16577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 0 00000100:00100000:2.0:1788830717.245810:0:14464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578443008 00000100:00100000:2.0:1788830717.245816:0:14464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578443008 00000100:00100000:2.0:1788830717.245856:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 32 00000100:00100000:2.0:1788830717.245864:0:14464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25747c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d08645c-98b4-449f-9d92-4c318beec94d+18:14452:x1875724578443008:12345-192.168.201.21@tcp:54:lfs.0 00010000:00010000:2.0:1788830717.245976:0:14464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8c000/0x575506951eea209e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830717.245990:0:14464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8c000/0x575506951eea209e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830717.246001:0:14464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8c000/0x575506951eea209e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830717.246034:0:14464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8c000/0x575506951eea209e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830717.246041:0:14464:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8c000/0x575506951eea209e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830717.246047:0:14464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8c000/0x575506951eea209e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830717.246060:0:14464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e257fa8c000 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:2.0:1788830717.246065:0:14464:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8c000/0x575506951eea209e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830717.246071:0:14464:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8c000/0x575506951eea209e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830717.246080:0:14464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e257480c400) 00010000:00010000:2.0:1788830717.246084:0:14464:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788830717.246087:0:14464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8c000/0x575506951eea209e lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830717.246093:0:14464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8c000/0x575506951eea209e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788830717.246185:0:14464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25747c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d08645c-98b4-449f-9d92-4c318beec94d+18:14452:x1875724578443008:12345-192.168.201.21@tcp:54:lfs.0 Request processed in 321us (1431us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830717.246193:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 32 00000100:00100000:2.0:1788830717.254444:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830717.254518:0:14467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578443392 00000100:00100000:3.0:1788830717.254528:0:14467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578443392 00000100:00100000:3.0:1788830717.254585:0:14467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 7 00000100:00100000:3.0:1788830717.254596:0:14467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257f725500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5d08645c-98b4-449f-9d92-4c318beec94d+18:14452:x1875724578443392:12345-192.168.201.21@tcp:35:lfs.0 00000100:00100000:3.0:1788830717.255122:0:14467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257f725500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5d08645c-98b4-449f-9d92-4c318beec94d+19:14452:x1875724578443392:12345-192.168.201.21@tcp:35:lfs.0 Request processed in 526us (686us total) trans 8589934605 rc 0/0 00000100:00100000:3.0:1788830717.255130:0:14467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 7 00000100:00100000:1.0:1788830717.557239:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830717.557407:0:16335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578443648 00000100:00100000:2.0:1788830717.557416:0:16335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578443648 00000100:00100000:2.0:1788830717.557488:0:16335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 33 00000100:00100000:2.0:1788830717.557498:0:16335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25658dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d08645c-98b4-449f-9d92-4c318beec94d+19:14483:x1875724578443648:12345-192.168.201.21@tcp:101:cat.0 00010000:00010000:2.0:1788830717.557521:0:16335:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788830717.557552:0:16335:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8c000/0x575506951eea20a5 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5789105346621ac expref: -99 pid: 16335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830717.557644:0:16335:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8ce00/0x575506951eea20ac lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830717.557673:0:16335:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8ce00/0x575506951eea20ac lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830717.557684:0:16335:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8ce00/0x575506951eea20ac lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16335 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788830717.557694:0:16335:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788830717.558055:0:16335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8c000/0x575506951eea20a5 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0xa5789105346621ac expref: 22 pid: 16335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830717.558075:0:16335:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8ce00/0x575506951eea20ac lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0xa5789105346621ac expref: 21 pid: 16335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830717.558084:0:16335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e257480c400) 00010000:00010000:2.0:1788830717.558087:0:16335:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788830717.558090:0:16335:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e257fa8ce00, rc 0) 00000100:00100000:2.0:1788830717.558190:0:16335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25658dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d08645c-98b4-449f-9d92-4c318beec94d+21:14483:x1875724578443648:12345-192.168.201.21@tcp:101:cat.0 Request processed in 694us (960us total) trans 8589934606 rc 0/0 00000100:00100000:2.0:1788830717.558196:0:16335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 33 00000100:00100000:0.0:1788830717.564563:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830717.565173:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578443776 00000100:00100000:2.0:1788830717.565183:0:14449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578443776 00000100:00100000:0.0:1788830717.565309:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830717.565378:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 1 00000100:00100000:2.0:1788830717.565390:0:14449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25478b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5d08645c-98b4-449f-9d92-4c318beec94d+21:2354:x1875724578443776:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788830717.565407:0:14449:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788830717.565432:0:14449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8ce00/0x575506951eea20ac lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.21@tcp remote: 0xa5789105346621ac expref: 21 pid: 16335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830717.565477:0:14449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e257480c400) 00010000:00010000:2.0:1788830717.565482:0:14449:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788830717.565542:0:14449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25478b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5d08645c-98b4-449f-9d92-4c318beec94d+20:2354:x1875724578443776:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 154us (989us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830717.565550:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 1 00000100:00100000:3.0:1788830717.565614:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578444032 00000100:00100000:3.0:1788830717.565618:0:14466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578444032 00000100:00100000:3.0:1788830717.565646:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 8 00000100:00100000:3.0:1788830717.565653:0:14466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25478b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5d08645c-98b4-449f-9d92-4c318beec94d+20:14483:x1875724578444032:12345-192.168.201.21@tcp:35:cat.0 00000100:00100000:3.0:1788830717.565950:0:14466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25478b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5d08645c-98b4-449f-9d92-4c318beec94d+21:14483:x1875724578444032:12345-192.168.201.21@tcp:35:cat.0 Request processed in 296us (641us total) trans 8589934607 rc 0/0 00000100:00100000:3.0:1788830717.565957:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 8 00000100:00100000:1.0:1788830717.638879:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830717.639099:0:14464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578444288 00000100:00100000:2.0:1788830717.639110:0:14464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578444288 00000100:00100000:2.0:1788830717.639248:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 34 00000100:00100000:2.0:1788830717.639259:0:14464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25658ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d08645c-98b4-449f-9d92-4c318beec94d+21:14489:x1875724578444288:12345-192.168.201.21@tcp:101:dd.0 00010000:00010000:2.0:1788830717.639287:0:14464:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788830717.639308:0:14464:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8ce00/0x575506951eea20ba lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5789105346621b3 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830717.639430:0:14464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8c000/0x575506951eea20c1 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830717.639460:0:14464:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea205f lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0xa578910534662190 expref: 22 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830717.639469:0:14464:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8d800/0x575506951eea2074 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0xa578910534662197 expref: 22 pid: 16335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830717.639478:0:14464:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8c000/0x575506951eea20c1 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830717.639511:0:14464:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8d800/0x575506951eea2074 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.21@tcp remote: 0xa578910534662197 expref: 22 pid: 16335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830717.639542:0:14464:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8d800/0x575506951eea2074 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.21@tcp remote: 0xa578910534662197 expref: 22 pid: 16335 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788830717.639556:0:14464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257f727100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14464:1875724595205760:192.168.201.21@tcp:104: 00010000:00010000:2.0:1788830717.639661:0:14464:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea205f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.21@tcp remote: 0xa578910534662190 expref: 22 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830717.639671:0:14464:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea205f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.21@tcp remote: 0xa578910534662190 expref: 22 pid: 14464 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788830717.639681:0:14464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257f727b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14464:1875724595205888:192.168.201.21@tcp:104: 00000100:00100000:2.0:1788830717.639700:0:14464:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e257fbd63c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788830717.644363:0:14464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257f727100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14464:1875724595205760:192.168.201.21@tcp:104: 00000100:00100000:2.0:1788830717.644382:0:14464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257f727b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14464:1875724595205888:192.168.201.21@tcp:104: 00010000:00010000:2.0:1788830717.644412:0:14464:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8c000/0x575506951eea20c1 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788830717.650956:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830717.651000:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830717.651206:0:16577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578444416 00000100:00100000:3.0:1788830717.651242:0:16577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578444416 00010000:00010000:3.0:1788830717.651282:0:16577:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8d800/0x575506951eea2074 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.21@tcp remote: 0xa578910534662197 expref: 23 pid: 16335 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788830717.651322:0:16577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578444544 00000100:00100000:3.0:1788830717.651325:0:16577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578444544 00010000:00010000:3.0:1788830717.651338:0:16577:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea205f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.21@tcp remote: 0xa578910534662190 expref: 24 pid: 14464 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788830717.651370:0:16577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 11 00000100:00100000:3.0:1788830717.651379:0:16577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257ede6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5d08645c-98b4-449f-9d92-4c318beec94d+24:2355:x1875724578444416:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788830717.651393:0:16577:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788830717.651400:0:16577:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8d800/0x575506951eea2074 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.21@tcp remote: 0xa578910534662197 expref: 24 pid: 16335 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830717.651414:0:16577:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8d800/0x575506951eea2074 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.21@tcp remote: 0xa578910534662197 expref: 24 pid: 16335 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830717.651437:0:16577:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8d800/0x575506951eea2074 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.21@tcp remote: 0xa578910534662197 expref: 24 pid: 16335 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830717.651454:0:16577:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e257480c400) 00010000:00010000:3.0:1788830717.651460:0:16577:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8c000/0x575506951eea20c1 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830717.651469:0:16577:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8c000/0x575506951eea20c1 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830717.651475:0:16577:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788830717.651533:0:16577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257ede6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5d08645c-98b4-449f-9d92-4c318beec94d+23:2355:x1875724578444416:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 154us (589us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830717.651541:0:16577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 11 00000100:00100000:3.0:1788830717.651592:0:16577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 12 00000100:00100000:3.0:1788830717.651773:0:16577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25658dce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5d08645c-98b4-449f-9d92-4c318beec94d+22:2355:x1875724578444544:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788830717.651784:0:16577:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788830717.651789:0:16577:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea205f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.21@tcp remote: 0xa578910534662190 expref: 22 pid: 14464 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830717.651869:0:16577:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea205f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.21@tcp remote: 0xa578910534662190 expref: 22 pid: 14464 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830717.651886:0:16577:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ff800/0x575506951eea205f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.21@tcp remote: 0xa578910534662190 expref: 22 pid: 14464 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830717.651963:0:16577:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e257480c400) 00010000:00010000:3.0:1788830717.651968:0:16577:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8c000/0x575506951eea20c1 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830717.651975:0:16577:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8c000/0x575506951eea20c1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830717.651982:0:16577:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8c000/0x575506951eea20c1 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830717.652004:0:16577:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788830717.652039:0:16577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25658dce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5d08645c-98b4-449f-9d92-4c318beec94d+21:2355:x1875724578444544:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 440us (1038us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830717.652046:0:16577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 12 00010000:00010000:2.0:1788830717.652458:0:14464:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8c000/0x575506951eea20c1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830717.652467:0:14464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8c000/0x575506951eea20c1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788830717.652488:0:14464:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788830717.652672:0:14464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8ce00/0x575506951eea20ba lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0xa5789105346621b3 expref: 22 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830717.652702:0:14464:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8c000/0x575506951eea20c1 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0xa5789105346621b3 expref: 21 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830717.652734:0:14464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e257480c400) 00010000:00010000:2.0:1788830717.652737:0:14464:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788830717.652740:0:14464:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e257fa8c000, rc 0) 00000100:00100000:2.0:1788830717.652771:0:14464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25658ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d08645c-98b4-449f-9d92-4c318beec94d+21:14489:x1875724578444288:12345-192.168.201.21@tcp:101:dd.0 Request processed in 13515us (13903us total) trans 8589934608 rc 0/0 00000100:00100000:2.0:1788830717.652779:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 34 00000100:00100000:0.0:1788830717.655983:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830717.656202:0:14463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578444800 00000100:00100000:1.0:1788830717.656224:0:14463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578444800 00000100:00100000:1.0:1788830717.656282:0:14463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 35 00000100:00100000:1.0:1788830717.656293:0:14463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25478b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d08645c-98b4-449f-9d92-4c318beec94d+21:14489:x1875724578444800:12345-192.168.201.21@tcp:36:dd.0 00010000:00010000:1.0:1788830717.656586:0:14463:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe600/0x575506951eea20cf lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830717.656630:0:14463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe600/0x575506951eea20cf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830717.656645:0:14463:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe600/0x575506951eea20cf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14463 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788830717.656702:0:14463:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:1.0:1788830717.656766:0:14463:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a4651d39 reply state 0000000078158f70 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe600/0x575506951eea20cf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14463 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788830717.656777:0:14463:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788830717.657455:0:14463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25478b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d08645c-98b4-449f-9d92-4c318beec94d+24:14489:x1875724578444800:12345-192.168.201.21@tcp:36:dd.0 Request processed in 1159us (1477us total) trans 8589934610 rc 0/0 00000100:00100000:1.0:1788830717.657464:0:14463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 35 00000020:00080000:1.0:1788830717.657470:0:14463:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788830717.660225:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788830717.665015:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe600/0x575506951eea20cf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830717.665043:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe600/0x575506951eea20cf lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830717.665051:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe600/0x575506951eea20cf lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830717.665058:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e25820fe600 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:2.0:1788830717.665062:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe600/0x575506951eea20cf lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830717.665071:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe600/0x575506951eea20cf lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830717.665088:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e257480c400) 00010000:00010000:2.0:1788830717.665092:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788830717.665096:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe600/0x575506951eea20cf lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830717.665118:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe600/0x575506951eea20cf lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14463 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788830717.665927:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830717.666202:0:14465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578444928 00000100:00100000:2.0:1788830717.666222:0:14465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578444928 00000100:00100000:2.0:1788830717.666272:0:14465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 36 00000100:00100000:2.0:1788830717.666282:0:14465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25478b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d08645c-98b4-449f-9d92-4c318beec94d+23:14489:x1875724578444928:12345-192.168.201.21@tcp:101:dd.0 00010000:00010000:2.0:1788830717.666306:0:14465:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788830717.666324:0:14465:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8ce00/0x575506951eea20d6 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5789105346621ba expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830717.666382:0:14465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8ce00/0x575506951eea20d6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.21@tcp remote: 0xa5789105346621ba expref: 24 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830717.666397:0:14465:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8ce00/0x575506951eea20d6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0xa5789105346621ba expref: 24 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830717.666417:0:14465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e257480c400) 00010000:00010000:2.0:1788830717.666420:0:14465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788830717.666423:0:14465:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e257fa8ce00, rc 0) 00000100:00100000:2.0:1788830717.666488:0:14465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25478b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d08645c-98b4-449f-9d92-4c318beec94d+24:14489:x1875724578444928:12345-192.168.201.21@tcp:101:dd.0 Request processed in 207us (569us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830717.666495:0:14465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 36 00000100:00100000:3.0:1788830717.691007:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830717.691183:0:16577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578445184 00000100:00100000:2.0:1788830717.691194:0:16577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578445184 00000100:00100000:2.0:1788830717.691266:0:16577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 2 00000100:00100000:2.0:1788830717.691277:0:16577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257f732a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5d08645c-98b4-449f-9d92-4c318beec94d+24:14489:x1875724578445184:12345-192.168.201.21@tcp:103:dd.0 00010000:00010000:2.0:1788830717.691303:0:16577:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788830717.691328:0:16577:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8ce00/0x575506951eea20d6 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.21@tcp remote: 0xa5789105346621ba expref: 24 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830717.691344:0:16577:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e257480c400) 00010000:00010000:2.0:1788830717.691348:0:16577:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788830717.691459:0:16577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257f732a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5d08645c-98b4-449f-9d92-4c318beec94d+23:14489:x1875724578445184:12345-192.168.201.21@tcp:103:dd.0 Request processed in 183us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830717.691466:0:16577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 2 00000100:00100000:1.0:1788830717.698405:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830717.698517:0:16335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578445312 00000100:00100000:2.0:1788830717.698528:0:16335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578445312 00000100:00100000:2.0:1788830717.698628:0:16335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 37 00000100:00100000:2.0:1788830717.698639:0:16335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25658ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d08645c-98b4-449f-9d92-4c318beec94d+23:14489:x1875724578445312:12345-192.168.201.21@tcp:58:dd.0 00010000:00010000:2.0:1788830717.698809:0:16335:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8ce00/0x575506951eea20dd lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830717.698827:0:16335:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8ce00/0x575506951eea20dd lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830717.698839:0:16335:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8ce00/0x575506951eea20dd lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16335 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788830717.699629:0:16335:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788830717.699825:0:16335:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:2.0:1788830717.699900:0:16335:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:2.0:1788830717.700368:0:16335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25658ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d08645c-98b4-449f-9d92-4c318beec94d+23:14489:x1875724578445312:12345-192.168.201.21@tcp:58:dd.0 Request processed in 1727us (1968us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830717.700379:0:16335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 37 00000100:00100000:1.0:1788830717.705560:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830717.705667:0:14465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578445440 00000100:00100000:2.0:1788830717.705678:0:14465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578445440 00000100:00100000:2.0:1788830717.705947:0:14465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 38 00000100:00100000:2.0:1788830717.705959:0:14465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25658dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d08645c-98b4-449f-9d92-4c318beec94d+23:14489:x1875724578445440:12345-192.168.201.21@tcp:101:dd.0 00010000:00010000:2.0:1788830717.705981:0:14465:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788830717.706004:0:14465:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8d000/0x575506951eea20e4 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5789105346621c1 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830717.706071:0:14465:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8ce00/0x575506951eea20dd lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830717.706083:0:14465:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8d000/0x575506951eea20e4 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.21@tcp remote: 0xa5789105346621c1 expref: 24 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830717.706102:0:14465:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8ce00/0x575506951eea20dd lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 16335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830717.706116:0:14465:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8d000/0x575506951eea20e4 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0xa5789105346621c1 expref: 24 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830717.706129:0:14465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e257480c400) 00010000:00010000:2.0:1788830717.706132:0:14465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788830717.706136:0:14465:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8d000/0x575506951eea20e4 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0xa5789105346621c1 expref: 24 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830717.706144:0:14465:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e257fa8d000, rc 0) 00000100:00100000:2.0:1788830717.706198:0:14465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25658dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d08645c-98b4-449f-9d92-4c318beec94d+24:14489:x1875724578445440:12345-192.168.201.21@tcp:101:dd.0 Request processed in 243us (649us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830717.706203:0:14465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 38 00000100:00100000:3.0:1788830717.831598:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830717.831775:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830717.831795:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830717.831858:0:14463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578445952 00000100:00100000:1.0:1788830717.831871:0:14463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578445952 00000100:00100000:1.0:1788830717.831963:0:14463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 23 00000100:00100000:1.0:1788830717.831976:0:14463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257f730700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ade59d61-740e-497b-bdec-03aa0b1957da+11:2354:x1875724578445952:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:1.0:1788830717.832072:0:14463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257f730700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ade59d61-740e-497b-bdec-03aa0b1957da+11:2354:x1875724578445952:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 98us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830717.832081:0:14463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 23 00000100:00100000:3.0:1788830717.840564:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830717.840593:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830717.840683:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578445568 00000100:00100000:2.0:1788830717.840694:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578445568 00000100:00100000:2.0:1788830717.840765:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 120 00000100:00100000:2.0:1788830717.840775:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25519b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fe7320b8-b931-453c-a880-19896cc1f024+13:2354:x1875724578445568:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:2.0:1788830717.840848:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25519b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fe7320b8-b931-453c-a880-19896cc1f024+13:2354:x1875724578445568:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 74us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830717.840855:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 120 00000100:00100000:0.0:1788830717.842532:0:15146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578445696 00000100:00100000:0.0:1788830717.842548:0:15146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578445696 00000100:00100000:0.0:1788830717.842635:0:15146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578446208 00000100:00100000:0.0:1788830717.842639:0:15146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578446208 00000100:00100000:0.0:1788830717.842672:0:15146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 10 00000100:00100000:0.0:1788830717.842684:0:15146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257f733800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5d08645c-98b4-449f-9d92-4c318beec94d+5:2354:x1875724578445696:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:0.0:1788830717.842770:0:15146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257f733800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5d08645c-98b4-449f-9d92-4c318beec94d+5:2354:x1875724578445696:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 88us (11181us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830717.842778:0:15146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 10 00000100:00100000:0.0:1788830717.842797:0:15146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 11 00000100:00100000:0.0:1788830717.842803:0:15146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257f730000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ade59d61-740e-497b-bdec-03aa0b1957da+5:2354:x1875724578446208:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:0.0:1788830717.842829:0:15146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257f730000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ade59d61-740e-497b-bdec-03aa0b1957da+5:2354:x1875724578446208:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 26us (11033us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830717.842853:0:15146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 11 00000100:00080000:2.0:1788830717.843211:0:14459:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788830717.843216:0:14459:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788830717.843339:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830717.843523:0:15939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578445824 00000100:00100000:2.0:1788830717.843528:0:15939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578445824 00000100:00100000:2.0:1788830717.843617:0:15939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578446080 00000100:00100000:2.0:1788830717.843621:0:15939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578446080 00000100:00080000:3.0:1788830717.843729:0:14459:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788830717.843733:0:14459:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788830717.843812:0:15144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 12 00000100:00100000:1.0:1788830717.843822:0:15144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257f733b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5d08645c-98b4-449f-9d92-4c318beec94d+5:2354:x1875724578445824:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:1.0:1788830717.843876:0:15144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257f733b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5d08645c-98b4-449f-9d92-4c318beec94d+5:2354:x1875724578445824:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 56us (3282us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830717.843901:0:15144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 12 00000100:00100000:1.0:1788830717.852498:0:15144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 13 00000100:00100000:1.0:1788830717.852520:0:15144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257f731880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ade59d61-740e-497b-bdec-03aa0b1957da+5:2354:x1875724578446080:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:1.0:1788830717.852611:0:15144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257f731880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ade59d61-740e-497b-bdec-03aa0b1957da+5:2354:x1875724578446080:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 102us (9274us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830717.852618:0:15144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 13 00000040:00080000:2.0:1788830717.982176:0:14495:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788830717.982186:0:14495:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788830717.982226:0:14495:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1788830717.982234:0:14495:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1788830717.982382:0:14495:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257f727b80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14495:1875724595206016:192.168.201.21@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788830717.982551:0:14495:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e257f6fae40 going to sleep for 11 seconds 00000100:00100000:2.0:1788830717.991780:0:14495:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257f727b80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14495:1875724595206016:192.168.201.21@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788830717.991816:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830717.998804:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578446336 00000100:00100000:1.0:1788830717.998822:0:14474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578446336 00000100:00100000:1.0:1788830717.998896:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 0 00000100:00100000:1.0:1788830717.998908:0:14474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257f732d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:5d08645c-98b4-449f-9d92-4c318beec94d+24:14490:x1875724578446336:12345-192.168.201.21@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1788830717.999026:0:14474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257f732d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:5d08645c-98b4-449f-9d92-4c318beec94d+24:14490:x1875724578446336:12345-192.168.201.21@tcp:900:lhsmtool_posix.0 Request processed in 109us (7200us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830717.999034:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 0 00000100:00100000:3.0:1788830718.002818:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830718.002933:0:14464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578446464 00000100:00100000:0.0:1788830718.002943:0:14464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578446464 00000100:00100000:0.0:1788830718.003024:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 39 00000100:00100000:0.0:1788830718.003035:0:14464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257f731180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d08645c-98b4-449f-9d92-4c318beec94d+24:14490:x1875724578446464:12345-192.168.201.21@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788830718.003075:0:14464:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788830718.003194:0:14464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257f731180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d08645c-98b4-449f-9d92-4c318beec94d+24:14490:x1875724578446464:12345-192.168.201.21@tcp:53:lhsmtool_posix.0 Request processed in 161us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830718.003202:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 39 00000100:00080000:3.0:1788830718.003471:0:14459:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788830718.008159:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830718.008253:0:14463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578446592 00000100:00100000:1.0:1788830718.008262:0:14463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578446592 00000100:00100000:1.0:1788830718.008320:0:14463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 40 00000100:00100000:1.0:1788830718.008331:0:14463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257f727b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d08645c-98b4-449f-9d92-4c318beec94d+24:14490:x1875724578446592:12345-192.168.201.21@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788830718.008395:0:14463:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe200/0x575506951eea20eb lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830718.008411:0:14463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe200/0x575506951eea20eb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830718.008424:0:14463:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe200/0x575506951eea20eb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830718.008500:0:14463:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffe00/0x575506951eea20f2 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830718.008509:0:14463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffe00/0x575506951eea20f2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830718.008516:0:14463:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffe00/0x575506951eea20f2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830718.008539:0:14463:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe800/0x575506951eea20f9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830718.008547:0:14463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe800/0x575506951eea20f9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830718.008554:0:14463:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe800/0x575506951eea20f9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14463 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788830718.008603:0:14463:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1788830718.008608:0:14463:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788830718.008623:0:14463:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe800/0x575506951eea20f9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830718.008634:0:14463:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe200/0x575506951eea20eb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830718.008641:0:14463:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe200/0x575506951eea20eb lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830718.008648:0:14463:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe200/0x575506951eea20eb lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830718.008666:0:14463:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e25820fe200 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:1.0:1788830718.008670:0:14463:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe200/0x575506951eea20eb lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830718.008677:0:14463:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe200/0x575506951eea20eb lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830718.008689:0:14463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e2549d42a00) 00010000:00010000:1.0:1788830718.008693:0:14463:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788830718.008697:0:14463:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe200/0x575506951eea20eb lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830718.008703:0:14463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe200/0x575506951eea20eb lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830718.008755:0:14463:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffe00/0x575506951eea20f2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830718.008762:0:14463:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffe00/0x575506951eea20f2 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830718.008768:0:14463:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffe00/0x575506951eea20f2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830718.008773:0:14463:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e25820ffe00 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:1.0:1788830718.008776:0:14463:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffe00/0x575506951eea20f2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830718.008782:0:14463:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffe00/0x575506951eea20f2 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830718.008802:0:14463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff9e257480c100) 00010000:00010000:1.0:1788830718.008805:0:14463:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788830718.008808:0:14463:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffe00/0x575506951eea20f2 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830718.008815:0:14463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffe00/0x575506951eea20f2 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830718.008829:0:14463:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe800/0x575506951eea20f9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830718.008836:0:14463:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe800/0x575506951eea20f9 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830718.008842:0:14463:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe800/0x575506951eea20f9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830718.008847:0:14463:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e25820fe800 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:1.0:1788830718.008850:0:14463:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe800/0x575506951eea20f9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830718.008855:0:14463:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe800/0x575506951eea20f9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830718.008862:0:14463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e257480c400) 00010000:00010000:1.0:1788830718.008865:0:14463:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788830718.008867:0:14463:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe800/0x575506951eea20f9 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830718.008873:0:14463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe800/0x575506951eea20f9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14463 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788830718.008974:0:14463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257f727b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d08645c-98b4-449f-9d92-4c318beec94d+24:14490:x1875724578446592:12345-192.168.201.21@tcp:34:lhsmtool_posix.0 Request processed in 643us (823us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830718.008983:0:14463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 40 00000100:00100000:1.0:1788830718.013833:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830718.014298:0:14465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578446848 00000100:00100000:2.0:1788830718.014310:0:14465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578446848 00000100:00100000:2.0:1788830718.014409:0:14465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 41 00000100:00100000:2.0:1788830718.014420:0:14465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25658dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d08645c-98b4-449f-9d92-4c318beec94d+24:14490:x1875724578446848:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788830718.014440:0:14465:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788830718.014459:0:14465:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8de00/0x575506951eea2100 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5789105346621c8 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830718.014584:0:14465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8d600/0x575506951eea2107 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830718.014609:0:14465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8d600/0x575506951eea2107 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830718.014621:0:14465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8d600/0x575506951eea2107 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788830718.014633:0:14465:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788830718.014767:0:14465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8d600/0x575506951eea2107 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830718.014775:0:14465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8d600/0x575506951eea2107 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830718.014782:0:14465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8d600/0x575506951eea2107 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830718.014788:0:14465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e257fa8d600 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:2.0:1788830718.014792:0:14465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8d600/0x575506951eea2107 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830718.014811:0:14465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8d600/0x575506951eea2107 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830718.014825:0:14465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e257480c400) 00010000:00010000:2.0:1788830718.014827:0:14465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788830718.014832:0:14465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8d600/0x575506951eea2107 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830718.014851:0:14465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8d600/0x575506951eea2107 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830718.014896:0:14465:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8de00/0x575506951eea2100 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0xa5789105346621c8 expref: 26 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830718.014906:0:14465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e2549d42a00) 00010000:00010000:2.0:1788830718.014909:0:14465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788830718.014913:0:14465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8de00/0x575506951eea2100 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.21@tcp remote: 0xa5789105346621c8 expref: 26 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830718.014934:0:14465:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e257fa8de00, rc 0) 00000100:00100000:2.0:1788830718.014996:0:14465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25658dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d08645c-98b4-449f-9d92-4c318beec94d+25:14490:x1875724578446848:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 Request processed in 577us (1172us total) trans 8589934611 rc 301/301 00000100:00100000:2.0:1788830718.015003:0:14465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 41 00000100:00100000:3.0:1788830718.018007:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830718.018081:0:14463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578446976 00000100:00100000:1.0:1788830718.018092:0:14463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578446976 00000100:00100000:1.0:1788830718.018154:0:14463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 42 00000100:00100000:1.0:1788830718.018164:0:14463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257f731500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d08645c-98b4-449f-9d92-4c318beec94d+25:14490:x1875724578446976:12345-192.168.201.21@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788830718.018199:0:14463:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788830718.018320:0:14463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257f731500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d08645c-98b4-449f-9d92-4c318beec94d+25:14490:x1875724578446976:12345-192.168.201.21@tcp:53:lhsmtool_posix.0 Request processed in 157us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830718.018328:0:14463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 42 00000100:00100000:3.0:1788830718.021564:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830718.021687:0:14464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578447232 00000100:00100000:0.0:1788830718.021698:0:14464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578447232 00000100:00100000:0.0:1788830718.021778:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 43 00000100:00100000:0.0:1788830718.021787:0:14464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257f730a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d08645c-98b4-449f-9d92-4c318beec94d+25:14490:x1875724578447232:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788830718.021814:0:14464:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788830718.021834:0:14464:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7800/0x575506951eea2115 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5789105346621cf expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788830718.023236:0:14464:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x6:0x0], count =28 00000004:00080000:0.0:1788830718.023246:0:14464:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0x6:0x0]+28 in llog 00000004:00080000:0.0:1788830718.023304:0:14464:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x22:0x0], index 1: 0 00010000:00010000:0.0:1788830718.023698:0:14464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6400/0x575506951eea211c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830718.023741:0:14464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6400/0x575506951eea211c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830718.023754:0:14464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6400/0x575506951eea211c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830718.023903:0:14464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7800/0x575506951eea2115 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0xa5789105346621cf expref: 28 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830718.023984:0:14464:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6400/0x575506951eea211c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0xa5789105346621cf expref: 27 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830718.023993:0:14464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9e2549d42c00) 00010000:00010000:0.0:1788830718.023996:0:14464:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788830718.023999:0:14464:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e25658d6400, rc 0) 00000100:00100000:0.0:1788830718.024092:0:14464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257f730a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d08645c-98b4-449f-9d92-4c318beec94d+27:14490:x1875724578447232:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 Request processed in 2304us (2546us total) trans 8589934612 rc 0/0 00000100:00100000:0.0:1788830718.024101:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 43 00000100:00100000:3.0:1788830718.028408:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830718.028517:0:14463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578447488 00000100:00100000:1.0:1788830718.028527:0:14463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578447488 00000100:00100000:1.0:1788830718.028604:0:14463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 44 00000100:00100000:1.0:1788830718.028614:0:14463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257f731f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d08645c-98b4-449f-9d92-4c318beec94d+27:14490:x1875724578447488:12345-192.168.201.21@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788830718.028673:0:14463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788830718.028699:0:14463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6400/0x575506951eea211c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.21@tcp remote: 0xa5789105346621cf expref: 27 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830718.028748:0:14463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9e2549d42c00) 00010000:00010000:1.0:1788830718.028761:0:14463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788830718.028784:0:14463:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe800/0x575506951eea212a lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830718.028798:0:14463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe800/0x575506951eea212a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830718.028821:0:14463:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe800/0x575506951eea212a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830718.028879:0:14463:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffe00/0x575506951eea2131 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x9cb9a264 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830718.028887:0:14463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffe00/0x575506951eea2131 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x9cb9a264 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830718.028907:0:14463:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffe00/0x575506951eea2131 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x9cb9a264 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830718.028969:0:14463:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe800/0x575506951eea212a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830718.028977:0:14463:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe800/0x575506951eea212a lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830718.028983:0:14463:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe800/0x575506951eea212a lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830718.028989:0:14463:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e25820fe800 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:1.0:1788830718.028993:0:14463:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe800/0x575506951eea212a lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830718.029000:0:14463:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe800/0x575506951eea212a lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830718.029009:0:14463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9e2551f3e800) 00010000:00010000:1.0:1788830718.029012:0:14463:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788830718.029131:0:14463:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe800/0x575506951eea212a lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830718.029143:0:14463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820fe800/0x575506951eea212a lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830718.029153:0:14463:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffe00/0x575506951eea2131 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x9cb9a264 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830718.029158:0:14463:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffe00/0x575506951eea2131 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x9cb9a264 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830718.029163:0:14463:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffe00/0x575506951eea2131 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x9cb9a264 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830718.029168:0:14463:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e25820ffe00 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:1.0:1788830718.029171:0:14463:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffe00/0x575506951eea2131 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x9cb9a264 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830718.029176:0:14463:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffe00/0x575506951eea2131 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x9cb9a264 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830718.029183:0:14463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x9cb9a264 (ffff9e257480c100) 00010000:00010000:1.0:1788830718.029185:0:14463:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788830718.029188:0:14463:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffe00/0x575506951eea2131 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x9cb9a264 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830718.029192:0:14463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25820ffe00/0x575506951eea2131 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x9cb9a264 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14463 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788830718.029270:0:14463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257f731f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d08645c-98b4-449f-9d92-4c318beec94d+26:14490:x1875724578447488:12345-192.168.201.21@tcp:36:lhsmtool_posix.0 Request processed in 657us (872us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788830718.029277:0:14463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 44 00000100:00100000:3.0:1788830718.038373:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830718.038478:0:14465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578447616 00000100:00100000:2.0:1788830718.038488:0:14465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578447616 00000100:00100000:2.0:1788830718.038551:0:14465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 45 00000100:00100000:2.0:1788830718.038561:0:14465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257f733480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d08645c-98b4-449f-9d92-4c318beec94d+26:14490:x1875724578447616:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788830718.038579:0:14465:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788830718.038599:0:14465:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8de00/0x575506951eea2138 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5789105346621d6 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830718.038634:0:14465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8d600/0x575506951eea213f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830718.038645:0:14465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8d600/0x575506951eea213f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830718.038667:0:14465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8d600/0x575506951eea213f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830718.038791:0:14465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8de00/0x575506951eea2138 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0xa5789105346621d6 expref: 28 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830718.038809:0:14465:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8d600/0x575506951eea213f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0xa5789105346621d6 expref: 27 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830718.038817:0:14465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9e2551f3e000) 00010000:00010000:2.0:1788830718.038820:0:14465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788830718.038823:0:14465:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e257fa8d600, rc 0) 00000100:00100000:2.0:1788830718.039117:0:14465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257f733480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d08645c-98b4-449f-9d92-4c318beec94d+27:14490:x1875724578447616:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 Request processed in 556us (754us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830718.039124:0:14465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 45 00000100:00100000:3.0:1788830718.045194:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830718.045449:0:16335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578447872 00000100:00100000:2.0:1788830718.045460:0:16335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578447872 00000100:00100000:2.0:1788830718.045531:0:16335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 46 00000100:00100000:2.0:1788830718.045541:0:16335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25747c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d08645c-98b4-449f-9d92-4c318beec94d+27:14490:x1875724578447872:12345-192.168.201.21@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788830718.045637:0:16335:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8de00/0x575506951eea2146 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830718.045656:0:16335:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8de00/0x575506951eea2146 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830718.045668:0:16335:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8de00/0x575506951eea2146 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16335 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788830718.046270:0:16335:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:2.0:1788830718.046282:0:16335:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 471393571626ns, next at 472393569428ns, rc = 0 00000004:00010000:2.0:1788830718.046371:0:16335:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000055eb8c49 reply state 0000000068d550a7 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8de00/0x575506951eea2146 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16335 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788830718.046382:0:16335:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788830718.046479:0:16335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25747c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d08645c-98b4-449f-9d92-4c318beec94d+29:14490:x1875724578447872:12345-192.168.201.21@tcp:36:lhsmtool_posix.0 Request processed in 938us (1294us total) trans 8589934613 rc 0/0 00000100:00100000:2.0:1788830718.046489:0:16335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 46 00010000:00010000:1.0:1788830718.050038:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8de00/0x575506951eea2146 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830718.050056:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8de00/0x575506951eea2146 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830718.050063:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8de00/0x575506951eea2146 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830718.050069:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e257fa8de00 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:1.0:1788830718.050074:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8de00/0x575506951eea2146 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830718.050081:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8de00/0x575506951eea2146 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830718.050098:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9e2551f3e000) 00010000:00010000:1.0:1788830718.050101:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788830718.050106:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8de00/0x575506951eea2146 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830718.050112:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8de00/0x575506951eea2146 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16335 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788830718.058800:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830718.058886:0:14464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578448000 00000100:00100000:0.0:1788830718.058896:0:14464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578448000 00000100:00100000:0.0:1788830718.058958:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 47 00000100:00100000:0.0:1788830718.058968:0:14464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e256549bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d08645c-98b4-449f-9d92-4c318beec94d+28:14490:x1875724578448000:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788830718.058990:0:14464:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788830718.059011:0:14464:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7800/0x575506951eea214d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5789105346621dd expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830718.059094:0:14464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7800/0x575506951eea214d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.21@tcp remote: 0xa5789105346621dd expref: 29 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830718.059108:0:14464:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7800/0x575506951eea214d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0xa5789105346621dd expref: 29 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830718.059146:0:14464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9e2551f3e000) 00010000:00010000:0.0:1788830718.059149:0:14464:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788830718.059153:0:14464:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e25658d7800, rc 0) 00000100:00100000:0.0:1788830718.059208:0:14464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e256549bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d08645c-98b4-449f-9d92-4c318beec94d+29:14490:x1875724578448000:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 Request processed in 241us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830718.059214:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 47 00000100:00100000:3.0:1788830718.063375:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830718.063830:0:15144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578448128 00000100:00100000:1.0:1788830718.063843:0:15144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578448128 00000100:00100000:1.0:1788830718.063907:0:15144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 10 00000100:00100000:1.0:1788830718.063925:0:15144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2565499180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5d08645c-98b4-449f-9d92-4c318beec94d+5:2355:x1875724578448128:12345-192.168.201.21@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1788830718.064319:0:15144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2565499180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5d08645c-98b4-449f-9d92-4c318beec94d+6:2355:x1875724578448128:12345-192.168.201.21@tcp:2:lhsmtool_posix.0 Request processed in 401us (954us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1788830718.064328:0:15144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 10 00000100:00100000:3.0:1788830718.071228:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830718.071742:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578448384 00000100:00100000:2.0:1788830718.071753:0:14466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578448384 00000100:00100000:2.0:1788830718.071823:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 9 00000100:00100000:2.0:1788830718.071845:0:14466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e256549b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5d08645c-98b4-449f-9d92-4c318beec94d+29:14490:x1875724578448384:12345-192.168.201.21@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788830718.072113:0:14466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e256549b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5d08645c-98b4-449f-9d92-4c318beec94d+30:14490:x1875724578448384:12345-192.168.201.21@tcp:35:lhsmtool_posix.0 Request processed in 280us (894us total) trans 8589934614 rc 0/0 00000100:00100000:2.0:1788830718.072121:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 9 00000100:00100000:3.0:1788830718.079093:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830718.080047:0:14463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578448640 00000100:00100000:1.0:1788830718.080061:0:14463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578448640 00000100:00100000:1.0:1788830718.080135:0:14463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 48 00000100:00100000:1.0:1788830718.080147:0:14463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e256549a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d08645c-98b4-449f-9d92-4c318beec94d+30:14490:x1875724578448640:12345-192.168.201.21@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788830718.080338:0:14463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e256549a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d08645c-98b4-449f-9d92-4c318beec94d+30:14490:x1875724578448640:12345-192.168.201.21@tcp:57:lhsmtool_posix.0 Request processed in 192us (1254us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830718.080346:0:14463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 48 00000100:00100000:3.0:1788830718.090152:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830718.090681:0:14464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578448768 00000100:00100000:0.0:1788830718.090692:0:14464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578448768 00000100:00100000:0.0:1788830718.090785:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 49 00000100:00100000:0.0:1788830718.090795:0:14464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2565498000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d08645c-98b4-449f-9d92-4c318beec94d+30:14490:x1875724578448768:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788830718.090816:0:14464:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788830718.090836:0:14464:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6600/0x575506951eea2154 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5789105346621e4 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830718.090903:0:14464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7200/0x575506951eea215b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830718.090916:0:14464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7200/0x575506951eea215b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830718.090928:0:14464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7200/0x575506951eea215b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788830718.090965:0:14464:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788830718.090984:0:14464:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7200/0x575506951eea215b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830718.091023:0:14464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d6600/0x575506951eea2154 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0xa5789105346621e4 expref: 32 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830718.091189:0:14464:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7200/0x575506951eea215b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0xa5789105346621e4 expref: 31 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830718.091198:0:14464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9e2551f3e000) 00010000:00010000:0.0:1788830718.091200:0:14464:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788830718.091203:0:14464:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e25658d7200, rc 0) 00000100:00100000:0.0:1788830718.091266:0:14464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2565498000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d08645c-98b4-449f-9d92-4c318beec94d+31:14490:x1875724578448768:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 Request processed in 473us (1124us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830718.091273:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 49 00000100:00100000:3.0:1788830718.107232:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830718.107906:0:15145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578448896 00000100:00100000:2.0:1788830718.107919:0:15145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578448896 00000100:00100000:2.0:1788830718.107983:0:15145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 11 00000100:00100000:2.0:1788830718.107992:0:15145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2565499c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5d08645c-98b4-449f-9d92-4c318beec94d+6:2354:x1875724578448896:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788830718.108009:0:15145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788830718.108054:0:15145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d5ca2b34/0x575506951eea2162 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa5789105346621eb expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788830718.108088:0:15145:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9f63fd, blocks: 0x1 00010000:00010000:2.0:1788830718.108125:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=471s v=(0 0) 00010000:00010000:2.0:1788830718.108129:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788830718.108140:0:15145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d5ca2b34/0x575506951eea2162 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0xa5789105346621eb expref: 7 pid: 15145 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830718.108159:0:15145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d5ca2b34/0x575506951eea2162 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0xa5789105346621eb expref: 7 pid: 15145 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830718.108173:0:15145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e257fa8de00, rc 0) 00000100:00100000:2.0:1788830718.108242:0:15145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2565499c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5d08645c-98b4-449f-9d92-4c318beec94d+7:2354:x1875724578448896:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 Request processed in 251us (1019us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830718.108249:0:15145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 11 00000100:00100000:3.0:1788830718.115295:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830718.115845:0:14463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578449152 00000100:00100000:1.0:1788830718.115857:0:14463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578449152 00000100:00100000:1.0:1788830718.116228:0:14463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 50 00000100:00100000:1.0:1788830718.116240:0:14463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e256549a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d08645c-98b4-449f-9d92-4c318beec94d+31:14490:x1875724578449152:12345-192.168.201.21@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788830718.116351:0:14463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e256549a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d08645c-98b4-449f-9d92-4c318beec94d+31:14490:x1875724578449152:12345-192.168.201.21@tcp:57:lhsmtool_posix.0 Request processed in 114us (1066us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830718.116359:0:14463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 50 00000100:00100000:3.0:1788830718.127176:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830718.127348:0:14465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578449280 00000100:00100000:2.0:1788830718.127359:0:14465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578449280 00000100:00100000:2.0:1788830718.127423:0:14465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 51 00000100:00100000:2.0:1788830718.127434:0:14465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2565499f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d08645c-98b4-449f-9d92-4c318beec94d+31:14490:x1875724578449280:12345-192.168.201.21@tcp:44:lhsmtool_posix.0 00000100:00100000:3.0:1788830718.172139:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2565498700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875724595206528:0@lo:400:kworker.0 00000100:00100000:3.0:1788830718.172212:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830718.172275:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788830718.172295:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2565498a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3689682b-484d-410c-a8fd-1b98c0369c65:3309:1875724595206144:0@lo:400:kworker.0 00000100:00100000:3.0:1788830718.172326:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830718.172349:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2565499880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875724595206656:0@lo:400:kworker.0 00000100:00100000:3.0:1788830718.172371:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830718.172398:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e256549ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875724595206272:0@lo:400:kworker.0 00000100:00100000:3.0:1788830718.172424:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830718.172442:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2565498380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1875724595206784:0@lo:400:kworker.0 00000100:00100000:3.0:1788830718.172461:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830718.172478:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788830718.172483:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e256549b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875724595206400:0@lo:400:kworker.0 00000100:00100000:3.0:1788830718.172503:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830718.172539:0:14463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595206528 00000100:00100000:3.0:1788830718.172546:0:14463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595206528 00000100:00100000:3.0:1788830718.172584:0:14463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595206784 00000100:00100000:0.0:1788830718.172584:0:14464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595206656 00000100:00100000:3.0:1788830718.172591:0:14463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595206784 00000100:00100000:0.0:1788830718.172592:0:14464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595206656 00000100:00100000:1.0:1788830718.172809:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788830718.172819:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25658ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875724595207040:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788830718.172856:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788830718.173328:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788830718.173340:0:14464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e256549b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875724595206528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788830718.173404:0:14464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e256549b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875724595206528:12345-0@lo:400:kworker.0 Request processed in 66us (1190us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830718.173412:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788830718.173432:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788830718.173438:0:14464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2565499500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875724595206656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788830718.173473:0:14464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2565499500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875724595206656:12345-0@lo:400:kworker.0 Request processed in 35us (1100us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830718.173480:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788830718.173905:0:16541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595207040 00000100:00100000:2.0:1788830718.173911:0:16541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595207040 00000100:00100000:2.0:1788830718.173951:0:16541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788830718.173959:0:16541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25658dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875724595207040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788830718.173985:0:16541:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788830718.174038:0:16541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25658dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875724595207040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (1181us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830718.174045:0:16541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788830718.174086:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25658ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875724595207040:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788830718.174126:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2565499880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875724595206656:0@lo:400:kworker.0 00000100:00100000:2.0:1788830718.174150:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2565498700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875724595206528:0@lo:400:kworker.0 00000100:00100000:3.0:1788830718.174578:0:14463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788830718.174588:0:14463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e256549aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875724595206784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788830718.174633:0:14463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e256549aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875724595206784:12345-0@lo:400:kworker.0 Request processed in 47us (2170us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830718.174640:0:14463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788830718.174668:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595206144 00000100:00100000:3.0:1788830718.174672:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595206144 00000100:00100000:3.0:1788830718.174704:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788830718.174729:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25519b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3689682b-484d-410c-a8fd-1b98c0369c65+19:3309:x1875724595206144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788830718.174763:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25519b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3689682b-484d-410c-a8fd-1b98c0369c65+19:3309:x1875724595206144:12345-0@lo:400:kworker.0 Request processed in 37us (2437us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830718.174779:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788830718.174815:0:15144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595206272 00000100:00100000:3.0:1788830718.174819:0:15144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595206272 00000100:00100000:3.0:1788830718.175208:0:15144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595206400 00000100:00100000:3.0:1788830718.175213:0:15144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595206400 00000100:00100000:3.0:1788830718.175304:0:15144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788830718.175312:0:15144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2565498e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875724595206272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788830718.175343:0:15144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2565498e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875724595206272:12345-0@lo:400:kworker.0 Request processed in 32us (2918us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830718.175349:0:15144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788830718.175359:0:15144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788830718.175363:0:15144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2544ee5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875724595206400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788830718.175383:0:15144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2544ee5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875724595206400:12345-0@lo:400:kworker.0 Request processed in 20us (2879us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830718.175388:0:15144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788830718.175537:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257f727100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875724595206912:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788830718.175569:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788830718.175607:0:14459:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788830718.175611:0:14459:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788830718.175614:0:14459:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788830718.175636:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e256549b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875724595206400:0@lo:400:kworker.0 00000100:00100000:3.0:1788830718.175646:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e256549ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875724595206272:0@lo:400:kworker.0 00000100:00100000:3.0:1788830718.175655:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2565498380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1875724595206784:0@lo:400:kworker.0 00000100:00100000:3.0:1788830718.175681:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2565498a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3689682b-484d-410c-a8fd-1b98c0369c65:3309:1875724595206144:0@lo:400:kworker.0 00000100:00100000:0.0:1788830718.175757:0:15147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595206912 00000100:00100000:0.0:1788830718.175761:0:15147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595206912 00000100:00100000:0.0:1788830718.175789:0:15147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788830718.175795:0:15147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2544ee7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875724595206912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788830718.175823:0:15147:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788830718.176059:0:15147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2544ee7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875724595206912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 263us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830718.176066:0:15147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788830718.176125:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257f727100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875724595206912:0@lo:13:osp-pre-0-0.0 00000001:00080000:1.0:1788830718.182151:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934612 is committed 00000001:00080000:1.0:1788830718.182176:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934596 is committed 00000001:00080000:1.0:1788830718.182180:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:1.0:1788830718.182186:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:1.0:1788830718.182212:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:3.0:1788830718.182359:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788830718.182377:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2544ee4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875724595207168:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1788830718.182436:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830718.182474:0:15146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595207168 00000100:00100000:3.0:1788830718.182480:0:15146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595207168 00000100:00100000:3.0:1788830718.182520:0:15146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788830718.182527:0:15146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2544ee7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875724595207168:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1788830718.182663:0:15146:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1788830718.182666:0:15146:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1788830718.182669:0:15146:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788830718.182671:0:15146:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1788830717 -> 1788830717 00002000:00010000:3.0:1788830718.182673:0:15146:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1788830718.182707:0:15146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2544ee7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3309:x1875724595207168:12345-0@lo:2:osp-syn-1-0.0 Request processed in 180us (269us total) trans 8589934595 rc 0/0 00000100:00100000:3.0:1788830718.182733:0:15146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000004:00080000:3.0:1788830718.182769:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e2544ee4000/2, rc 0, transno 8589934595 00000100:00100000:3.0:1788830718.182774:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2544ee4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875724595207168:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788830718.183214:0:14465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2565499f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d08645c-98b4-449f-9d92-4c318beec94d+14:14490:x1875724578449280:12345-192.168.201.21@tcp:44:lhsmtool_posix.0 Request processed in 55780us (56047us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830718.183223:0:14465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 51 00000100:00100000:3.0:1788830718.186146:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830718.186267:0:15939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578449408 00000100:00100000:2.0:1788830718.186277:0:15939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578449408 00000100:00100000:2.0:1788830718.186367:0:15939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 13 00000100:00100000:2.0:1788830718.186378:0:15939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2544ee4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5d08645c-98b4-449f-9d92-4c318beec94d+7:2355:x1875724578449408:12345-192.168.201.21@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1788830718.186549:0:15939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2544ee4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5d08645c-98b4-449f-9d92-4c318beec94d+7:2355:x1875724578449408:12345-192.168.201.21@tcp:16:lhsmtool_posix.0 Request processed in 173us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830718.186558:0:15939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 13 00000100:00100000:3.0:1788830718.191305:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830718.191652:0:14464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578449664 00000100:00100000:0.0:1788830718.191666:0:14464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578449664 00000100:00100000:3.0:1788830718.191763:0:14463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 52 00000100:00100000:3.0:1788830718.191776:0:14463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2544ee6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d08645c-98b4-449f-9d92-4c318beec94d+14:14490:x1875724578449664:12345-192.168.201.21@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788830718.191831:0:14463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788830718.191859:0:14463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7200/0x575506951eea215b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.21@tcp remote: 0xa5789105346621e4 expref: 14 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830718.191913:0:14463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9e2551f3e000) 00010000:00010000:3.0:1788830718.191919:0:14463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788830718.191952:0:14463:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445f8fa00/0x575506951eea2169 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830718.191964:0:14463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445f8fa00/0x575506951eea2169 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830718.191973:0:14463:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445f8fa00/0x575506951eea2169 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14463 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788830718.192158:0:14463:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ee03dff1 reply state 00000000fcf9bb5c transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445f8fa00/0x575506951eea2169 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14463 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788830718.192167:0:14463:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788830718.192270:0:14463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2544ee6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d08645c-98b4-449f-9d92-4c318beec94d+15:14490:x1875724578449664:12345-192.168.201.21@tcp:36:lhsmtool_posix.0 Request processed in 498us (976us total) trans 8589934615 rc 0/0 00000100:00100000:3.0:1788830718.192278:0:14463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 52 00010000:00010000:2.0:1788830718.195003:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445f8fa00/0x575506951eea2169 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830718.195028:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445f8fa00/0x575506951eea2169 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830718.195036:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445f8fa00/0x575506951eea2169 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830718.195046:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2445f8fa00 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:2.0:1788830718.195050:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445f8fa00/0x575506951eea2169 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830718.195059:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445f8fa00/0x575506951eea2169 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830718.195075:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9e2551f3e000) 00010000:00010000:2.0:1788830718.195079:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788830718.195083:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445f8fa00/0x575506951eea2169 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830718.195105:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445f8fa00/0x575506951eea2169 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14463 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788830718.198266:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830718.198993:0:15146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578449792 00000100:00100000:0.0:1788830718.199003:0:15146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578449792 00000100:00100000:1.0:1788830718.199188:0:15146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 14 00000100:00100000:1.0:1788830718.199198:0:15146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2544ee7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5d08645c-98b4-449f-9d92-4c318beec94d+7:14490:x1875724578449792:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788830718.199215:0:15146:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788830718.199233:0:15146:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000028011214/0x575506951eea2170 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa5789105346621f2 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830718.199275:0:15146:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d5ca2b34/0x575506951eea2162 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0xa5789105346621eb expref: 8 pid: 15145 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830718.199284:0:15146:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788830718.199288:0:15146:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788830718.199293:0:15146:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000028011214/0x575506951eea2170 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.21@tcp remote: 0xa5789105346621f2 expref: 8 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830718.199323:0:15146:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d5ca2b34/0x575506951eea2162 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.21@tcp remote: 0xa5789105346621eb expref: 8 pid: 15145 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830718.199335:0:15146:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d5ca2b34/0x575506951eea2162 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.21@tcp remote: 0xa5789105346621eb expref: 8 pid: 15145 timeout: 571 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788830718.199348:0:15146:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25658dea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:15146:1875724595207296:192.168.201.21@tcp:104: 00000100:00100000:1.0:1788830718.199439:0:15146:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2553736780 going to sleep for 11 seconds 00000100:00100000:3.0:1788830718.202761:0:15146:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25658dea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:15146:1875724595207296:192.168.201.21@tcp:104: 00010000:00010000:3.0:1788830718.202798:0:15146:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000028011214/0x575506951eea2170 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.21@tcp remote: 0xa5789105346621f2 expref: 8 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830718.202820:0:15146:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e25820fe200, rc 0) 00000100:00100000:3.0:1788830718.202883:0:15146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2544ee7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5d08645c-98b4-449f-9d92-4c318beec94d+8:14490:x1875724578449792:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 Request processed in 3685us (4625us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830718.202901:0:15146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 14 00000100:00100000:2.0:1788830718.205275:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1788830718.205432:0:14448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578449920 00000100:00100000:1.0:1788830718.205443:0:14448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578449920 00010000:00010000:1.0:1788830718.205490:0:14448:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d5ca2b34/0x575506951eea2162 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.21@tcp remote: 0xa5789105346621eb expref: 8 pid: 15145 timeout: 571 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788830718.205541:0:14448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 13 00000100:00100000:1.0:1788830718.205552:0:14448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257f727100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5d08645c-98b4-449f-9d92-4c318beec94d+8:2355:x1875724578449920:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788830718.205568:0:14448:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788830718.205609:0:14448:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d5ca2b34/0x575506951eea2162 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.21@tcp remote: 0xa5789105346621eb expref: 8 pid: 15145 timeout: 571 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830718.205624:0:14448:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d5ca2b34/0x575506951eea2162 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.21@tcp remote: 0xa5789105346621eb expref: 8 pid: 15145 timeout: 571 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830718.205648:0:14448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d5ca2b34/0x575506951eea2162 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.21@tcp remote: 0xa5789105346621eb expref: 8 pid: 15145 timeout: 571 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830718.205667:0:14448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788830718.205671:0:14448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788830718.205678:0:14448:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000028011214/0x575506951eea2170 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.21@tcp remote: 0xa5789105346621f2 expref: 7 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830718.205688:0:14448:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000028011214/0x575506951eea2170 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.21@tcp remote: 0xa5789105346621f2 expref: 7 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830718.205783:0:14448:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000028011214/0x575506951eea2170 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.21@tcp remote: 0xa5789105346621f2 expref: 7 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788830718.205797:0:14448:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e25658dca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:14448:1875724595207424:192.168.201.21@tcp:105: 00000100:00100000:1.0:1788830718.205875:0:14448:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2553736900 going to sleep for 11 seconds 00000100:00100000:1.0:1788830718.211090:0:14448:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e25658dca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:14448:1875724595207424:192.168.201.21@tcp:105: 00010000:00010000:1.0:1788830718.211116:0:14448:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788830718.211176:0:14448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257f727100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5d08645c-98b4-449f-9d92-4c318beec94d+7:2355:x1875724578449920:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 5625us (5910us total) trans 0 rc 0/0 00000100:00100000:1.0:1788830718.211203:0:14448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 13 00000100:00100000:2.0:1788830718.213363:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830718.213451:0:15145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578450048 00000100:00100000:3.0:1788830718.213460:0:15145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578450048 00000100:00100000:3.0:1788830718.213514:0:15145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 15 00000100:00100000:3.0:1788830718.213525:0:15145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257f726680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5d08645c-98b4-449f-9d92-4c318beec94d+7:2354:x1875724578450048:12345-192.168.201.21@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788830718.213759:0:15145:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1788830718.213763:0:15145:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1788830717 00002000:00010000:3.0:1788830718.213766:0:15145:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 1788830716 00002000:00010000:3.0:1788830718.213768:0:15145:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1788830717 -> 1788830717 00002000:00010000:3.0:1788830718.213770:0:15145:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1788830718.213821:0:15145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257f726680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5d08645c-98b4-449f-9d92-4c318beec94d+8:2354:x1875724578450048:12345-192.168.201.21@tcp:2:lhsmtool_posix.0 Request processed in 298us (466us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1788830718.213828:0:15145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 15 00000100:00100000:2.0:1788830718.217680:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830718.218042:0:15144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578450176 00000100:00100000:3.0:1788830718.218053:0:15144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578450176 00000100:00100000:2.0:1788830718.218227:0:15144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 16 00000100:00100000:2.0:1788830718.218238:0:15144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257f727800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5d08645c-98b4-449f-9d92-4c318beec94d+8:2355:x1875724578450176:12345-192.168.201.21@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788830718.218285:0:15144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000ad414220/0x575506951eea2177 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830718.218306:0:15144:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000028011214/0x575506951eea2170 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.21@tcp remote: 0xa5789105346621f2 expref: 8 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830718.218316:0:15144:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788830718.218320:0:15144:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788830718.218325:0:15144:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ad414220/0x575506951eea2177 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830718.218360:0:15144:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000028011214/0x575506951eea2170 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.21@tcp remote: 0xa5789105346621f2 expref: 8 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830718.218375:0:15144:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000028011214/0x575506951eea2170 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.21@tcp remote: 0xa5789105346621f2 expref: 8 pid: 15146 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788830718.218408:0:15144:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e257f724e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:15144:1875724595207552:192.168.201.21@tcp:104: 00000100:00100000:2.0:1788830718.218497:0:15144:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2547fe8300 going to sleep for 11 seconds 00000100:00100000:1.0:1788830718.222112:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830718.222226:0:15144:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e257f724e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:15144:1875724595207552:192.168.201.21@tcp:104: 00010000:00010000:2.0:1788830718.222253:0:15144:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ad414220/0x575506951eea2177 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788830718.222409:0:16577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578450304 00000100:00100000:3.0:1788830718.222416:0:16577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578450304 00010000:00010000:3.0:1788830718.222451:0:16577:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000028011214/0x575506951eea2170 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.21@tcp remote: 0xa5789105346621f2 expref: 9 pid: 15146 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788830718.222526:0:16577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 14 00000100:00100000:3.0:1788830718.222536:0:16577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25658dca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5d08645c-98b4-449f-9d92-4c318beec94d+9:2354:x1875724578450304:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788830718.222552:0:16577:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788830718.222575:0:16577:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000028011214/0x575506951eea2170 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.21@tcp remote: 0xa5789105346621f2 expref: 9 pid: 15146 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830718.222587:0:16577:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000028011214/0x575506951eea2170 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.21@tcp remote: 0xa5789105346621f2 expref: 9 pid: 15146 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830718.222621:0:16577:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000028011214/0x575506951eea2170 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.21@tcp remote: 0xa5789105346621f2 expref: 9 pid: 15146 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830718.222636:0:16577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788830718.222641:0:16577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788830718.222647:0:16577:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ad414220/0x575506951eea2177 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830718.222656:0:16577:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ad414220/0x575506951eea2177 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830718.222683:0:16577:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788830718.222778:0:16577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25658dca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5d08645c-98b4-449f-9d92-4c318beec94d+8:2354:x1875724578450304:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 243us (674us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830718.222785:0:16577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 14 00010000:00010000:2.0:1788830718.223003:0:15144:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ad414220/0x575506951eea2177 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830718.223023:0:15144:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ad414220/0x575506951eea2177 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830718.223045:0:15144:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000ad414220/0x575506951eea2177 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830718.223054:0:15144:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ad414220/0x575506951eea2177 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830718.223061:0:15144:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ad414220/0x575506951eea2177 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830718.223068:0:15144:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e257fa8c800 already unused, calling callback (ffffffffc14cb350) 00010000:00010000:2.0:1788830718.223072:0:15144:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ad414220/0x575506951eea2177 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830718.223091:0:15144:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ad414220/0x575506951eea2177 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830718.223103:0:15144:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ad414220/0x575506951eea2177 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830718.223111:0:15144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ad414220/0x575506951eea2177 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788830718.223153:0:15144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257f727800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5d08645c-98b4-449f-9d92-4c318beec94d+7:2355:x1875724578450176:12345-192.168.201.21@tcp:1:lhsmtool_posix.0 Request processed in 4917us (5485us total) trans 0 rc 0/0 00000100:00100000:2.0:1788830718.223161:0:15144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 16 00000100:00100000:1.0:1788830718.227367:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830718.227458:0:16335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578450560 00000100:00100000:3.0:1788830718.227468:0:16335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578450560 00000100:00100000:3.0:1788830718.227554:0:16335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 53 00000100:00100000:3.0:1788830718.227564:0:16335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25658de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d08645c-98b4-449f-9d92-4c318beec94d+14:14490:x1875724578450560:12345-192.168.201.21@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788830718.227642:0:16335:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445f8ec00/0x575506951eea217e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830718.227659:0:16335:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445f8ec00/0x575506951eea217e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830718.227672:0:16335:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445f8ec00/0x575506951eea217e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830718.227967:0:16335:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445f8fc00/0x575506951eea2185 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830718.227980:0:16335:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7800/0x575506951eea214d lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0xa5789105346621dd expref: 15 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830718.227988:0:16335:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445f8fc00/0x575506951eea2185 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830718.228030:0:16335:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7800/0x575506951eea214d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.21@tcp remote: 0xa5789105346621dd expref: 15 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830718.228044:0:16335:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7800/0x575506951eea214d lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.21@tcp remote: 0xa5789105346621dd expref: 15 pid: 14464 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788830718.228057:0:16335:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2544ee4700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16335:1875724595207680:192.168.201.21@tcp:104: 00000100:00100000:3.0:1788830718.228123:0:16335:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2548010b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788830718.230407:0:16335:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2544ee4700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16335:1875724595207680:192.168.201.21@tcp:104: 00010000:00010000:3.0:1788830718.230444:0:16335:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445f8fc00/0x575506951eea2185 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16335 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788830718.248648:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830718.248851:0:14450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578450688 00000100:00100000:0.0:1788830718.248860:0:14450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578450688 00010000:00010000:0.0:1788830718.248954:0:14450:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7800/0x575506951eea214d lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.21@tcp remote: 0xa5789105346621dd expref: 16 pid: 14464 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788830718.249046:0:14450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 15 00000100:00100000:0.0:1788830718.249056:0:14450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e257f724e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5d08645c-98b4-449f-9d92-4c318beec94d+16:2354:x1875724578450688:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788830718.249072:0:14450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788830718.249080:0:14450:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7800/0x575506951eea214d lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.21@tcp remote: 0xa5789105346621dd expref: 16 pid: 14464 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830718.249094:0:14450:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7800/0x575506951eea214d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.21@tcp remote: 0xa5789105346621dd expref: 16 pid: 14464 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830718.249118:0:14450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e25658d7800/0x575506951eea214d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.21@tcp remote: 0xa5789105346621dd expref: 16 pid: 14464 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830718.249153:0:14450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9e2551f3e000) 00010000:00010000:0.0:1788830718.249159:0:14450:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445f8fc00/0x575506951eea2185 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830718.249168:0:14450:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445f8fc00/0x575506951eea2185 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 16335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830718.249176:0:14450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445f8fc00/0x575506951eea2185 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 16335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830718.249208:0:14450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788830718.249266:0:14450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e257f724e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5d08645c-98b4-449f-9d92-4c318beec94d+15:2354:x1875724578450688:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 211us (628us total) trans 0 rc 0/0 00000100:00100000:0.0:1788830718.249273:0:14450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 15 00010000:00010000:3.0:1788830718.249330:0:16335:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445f8fc00/0x575506951eea2185 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830718.249339:0:16335:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445f8fc00/0x575506951eea2185 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16335 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788830718.249530:0:16335:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:3.0:1788830718.249683:0:16335:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:3.0:1788830718.249779:0:16335:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:3.0:1788830718.249873:0:16335:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2544ee4700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:16335:1875724595207808:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788830718.249978:0:16335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830718.250003:0:16335:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2544f05b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788830718.250047:0:14468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595207808 00000100:00100000:3.0:1788830718.250052:0:14468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595207808 00000100:00100000:3.0:1788830718.250079:0:14468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788830718.250086:0:14468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2544ee5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:16335:x1875724595207808:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788830718.250140:0:14468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2544ee5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:16335:x1875724595207808:12345-0@lo:1000:mdt00_003.0 Request processed in 55us (162us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830718.250147:0:14468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788830718.250179:0:16335:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2544ee4700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:16335:1875724595207808:0@lo:1000:mdt00_003.0 00000001:00080000:3.0:1788830718.250778:0:16335:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:3.0:1788830718.250828:0:16335:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2544ee4700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:16335:1875724595207936:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788830718.250857:0:16335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788830718.250872:0:16335:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2548010b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788830718.250886:0:14468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724595207936 00000100:00100000:3.0:1788830718.250890:0:14468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724595207936 00000100:00100000:3.0:1788830718.250912:0:14468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788830718.250918:0:14468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2544ee5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:16335:x1875724595207936:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788830718.251040:0:14468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2544ee5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:16335:x1875724595207936:12345-0@lo:1000:mdt00_003.0 Request processed in 121us (182us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1788830718.251047:0:14468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788830718.251075:0:16335:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2544ee4700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:16335:1875724595207936:0@lo:1000:mdt00_003.0 00010000:00010000:3.0:1788830718.251097:0:16335:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445f8fc00/0x575506951eea2185 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830718.251116:0:16335:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445f8fc00/0x575506951eea2185 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830718.251124:0:16335:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445f8fc00/0x575506951eea2185 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830718.251129:0:16335:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2445f8fc00 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:3.0:1788830718.251134:0:16335:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445f8fc00/0x575506951eea2185 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830718.251142:0:16335:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445f8fc00/0x575506951eea2185 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830718.251156:0:16335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9e2551f3e000) 00010000:00010000:3.0:1788830718.251158:0:16335:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788830718.251162:0:16335:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445f8fc00/0x575506951eea2185 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830718.251168:0:16335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445f8fc00/0x575506951eea2185 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830718.251192:0:16335:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8ce00/0x575506951eea20dd lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 16335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830718.251198:0:16335:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8ce00/0x575506951eea20dd lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 16335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830718.251204:0:16335:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8ce00/0x575506951eea20dd lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 16335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830718.251209:0:16335:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e257fa8ce00 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:3.0:1788830718.251216:0:16335:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8ce00/0x575506951eea20dd lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 16335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830718.251222:0:16335:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8ce00/0x575506951eea20dd lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 16335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830718.251229:0:16335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e257480c400) 00010000:00010000:3.0:1788830718.251231:0:16335:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788830718.251237:0:16335:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8d000/0x575506951eea20e4 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0xa5789105346621c1 expref: 18 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830718.251247:0:16335:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8d000/0x575506951eea20e4 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.21@tcp remote: 0xa5789105346621c1 expref: 18 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830718.251257:0:16335:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8d000/0x575506951eea20e4 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.21@tcp remote: 0xa5789105346621c1 expref: 18 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830718.251277:0:16335:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8d000/0x575506951eea20e4 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0xa5789105346621c1 expref: 18 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788830718.251286:0:16335:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e2544ee4380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16335:1875724595208064:192.168.201.21@tcp:105: 00000100:00100000:3.0:1788830718.251328:0:16335:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e2552e18240 going to sleep for 11 seconds 00000100:00100000:3.0:1788830718.256336:0:16335:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e2544ee4380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16335:1875724595208064:192.168.201.21@tcp:105: 00010000:00010000:3.0:1788830718.256371:0:16335:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8ce00/0x575506951eea20dd lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 16335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830718.256382:0:16335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e257fa8ce00/0x575506951eea20dd lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 16335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830718.256435:0:16335:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445f8e400/0x575506951eea218c lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830718.256449:0:16335:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445f8e400/0x575506951eea218c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830718.256462:0:16335:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445f8e400/0x575506951eea218c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830718.256472:0:16335:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445f8e400/0x575506951eea218c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830718.256479:0:16335:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445f8e400/0x575506951eea218c lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830718.256485:0:16335:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445f8e400/0x575506951eea218c lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830718.256491:0:16335:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2445f8e400 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:3.0:1788830718.256495:0:16335:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445f8e400/0x575506951eea218c lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830718.256502:0:16335:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445f8e400/0x575506951eea218c lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830718.256514:0:16335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e257480c400) 00010000:00010000:3.0:1788830718.256517:0:16335:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788830718.256521:0:16335:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445f8e400/0x575506951eea218c lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830718.256527:0:16335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445f8e400/0x575506951eea218c lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830718.256543:0:16335:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445f8ec00/0x575506951eea217e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830718.256549:0:16335:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445f8ec00/0x575506951eea217e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830718.256556:0:16335:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445f8ec00/0x575506951eea217e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830718.256561:0:16335:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2445f8ec00 already unused, calling callback (ffffffffc1f0e4f0) 00010000:00010000:3.0:1788830718.256564:0:16335:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445f8ec00/0x575506951eea217e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830718.256571:0:16335:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445f8ec00/0x575506951eea217e lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830718.256579:0:16335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e257480c400) 00010000:00010000:3.0:1788830718.256581:0:16335:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788830718.256584:0:16335:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445f8ec00/0x575506951eea217e lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830718.256589:0:16335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445f8ec00/0x575506951eea217e lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16335 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788830718.257193:0:16335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25658de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d08645c-98b4-449f-9d92-4c318beec94d+18:14490:x1875724578450560:12345-192.168.201.21@tcp:57:lhsmtool_posix.0 Request processed in 29627us (29833us total) trans 8589934620 rc 0/0 00000100:00100000:2.0:1788830718.257206:0:16335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 53 00000020:00080000:2.0:1788830718.257212:0:16335:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:2.0:1788830718.259607:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830718.259903:0:14467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578451072 00000100:00100000:3.0:1788830718.259913:0:14467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578451072 00000100:00100000:3.0:1788830718.259969:0:14467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 10 00000100:00100000:3.0:1788830718.259979:0:14467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e244532f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5d08645c-98b4-449f-9d92-4c318beec94d+18:14490:x1875724578451072:12345-192.168.201.21@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788830718.260680:0:14467:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788830718.260824:0:14467:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:3.0:1788830718.260879:0:14467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445f8e200/0x575506951eea2193 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830718.260896:0:14467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445f8e200/0x575506951eea2193 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830718.260908:0:14467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445f8e200/0x575506951eea2193 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830718.260916:0:14467:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445f8e200/0x575506951eea2193 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830718.260922:0:14467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445f8e200/0x575506951eea2193 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830718.260929:0:14467:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445f8e200/0x575506951eea2193 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830718.260948:0:14467:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788830718.261063:0:14467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e244532f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5d08645c-98b4-449f-9d92-4c318beec94d+20:14490:x1875724578451072:12345-192.168.201.21@tcp:35:lhsmtool_posix.0 Request processed in 1083us (1461us total) trans 8589934622 rc 0/0 00000100:00100000:3.0:1788830718.261073:0:14467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 10 00000020:00080000:3.0:1788830718.261078:0:14467:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788830718.262916:0:15935:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788830718.262931:0:15935:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445f8e200/0x575506951eea2193 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830718.262942:0:15935:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2445f8e200 already unused, calling callback (ffffffffc14cb350) 00010000:00010000:1.0:1788830718.262946:0:15935:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445f8e200/0x575506951eea2193 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830718.262955:0:15935:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445f8e200/0x575506951eea2193 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830718.262972:0:15935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9e2551f3e000) 00010000:00010000:1.0:1788830718.262975:0:15935:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788830718.262980:0:15935:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445f8e200/0x575506951eea2193 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830718.262986:0:15935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2445f8e200/0x575506951eea2193 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830718.263005:0:15935:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788830718.263007:0:15935:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788830718.263019:0:15935:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788830718.265001:0:14495:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788830718.265021:0:14495:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788830718.265056:0:14495:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1788830718.265062:0:14495:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1788830718.266179:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830718.266265:0:14467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578450816 00000100:00100000:3.0:1788830718.266275:0:14467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578450816 00000100:00100000:3.0:1788830718.266600:0:14467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 11 00000100:00100000:3.0:1788830718.266611:0:14467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25658dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5d08645c-98b4-449f-9d92-4c318beec94d+20:14489:x1875724578450816:12345-192.168.201.21@tcp:49:dd.0 00000100:00100000:3.0:1788830718.266774:0:14467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25658dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5d08645c-98b4-449f-9d92-4c318beec94d+20:14489:x1875724578450816:12345-192.168.201.21@tcp:49:dd.0 Request processed in 164us (602us total) trans 0 rc 0/0 00000100:00100000:3.0:1788830718.266782:0:14467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 11 00000100:00100000:3.0:1788830718.460811:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830718.460908:0:15149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578451200 00000100:00100000:0.0:1788830718.460919:0:15149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578451200 00000100:00100000:0.0:1788830718.460988:0:15149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 0 00000100:00100000:0.0:1788830718.460998:0:15149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2544ee4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5d08645c-98b4-449f-9d92-4c318beec94d+7:2352:x1875724578451200:12345-192.168.201.21@tcp:4:dd.0 00002000:00010000:0.0:1788830718.461058:0:15149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x6a9f63fd, atime: 0x6a9f63fc, ctime: 0x6a9f63fd, blocks: 0x1 00010000:00010000:0.0:1788830718.461068:0:15149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a3545b26/0x575506951eea219a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830718.461085:0:15149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=471s v=(0 0) 00010000:00010000:0.0:1788830718.461095:0:15149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788830718.461101:0:15149:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a3545b26/0x575506951eea219a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830718.461115:0:15149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a3545b26/0x575506951eea219a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788830718.464981:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830718.465066:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1788830718.465365:0:15150:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1788830718.465377:0:15150:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:0.0:1788830718.466148:0:15151:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1788830718.466165:0:15151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578451328 00000100:00100000:0.0:1788830718.466173:0:15151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578451328 00000100:00100000:0.0:1788830718.466216:0:15151:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1788830718.466220:0:15151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578451456 00000100:00100000:0.0:1788830718.466222:0:15151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578451456 00000100:00100000:2.0:1788830718.466844:0:16691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 1 00000100:00100000:2.0:1788830718.466857:0:16691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2544ee5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5d08645c-98b4-449f-9d92-4c318beec94d+10:2352:x1875724578451328:12345-192.168.201.21@tcp:4:dd.0 00010000:00010000:2.0:1788830718.466895:0:16691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d5ca2b34/0x575506951eea21a1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830718.466925:0:16691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788830718.466930:0:16691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788830718.466936:0:16691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d5ca2b34/0x575506951eea21a1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830718.466950:0:16691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d5ca2b34/0x575506951eea21a1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788830718.469070:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1788830718.469104:0:15151:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:3.0:1788830718.469112:0:15151:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:3.0:1788830718.469320:0:15151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578451584 00000100:00100000:3.0:1788830718.469330:0:15151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578451584 00000100:00100000:3.0:1788830718.470202:0:16692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 2 00000100:00100000:3.0:1788830718.470217:0:16692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2544ee6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5d08645c-98b4-449f-9d92-4c318beec94d+11:2352:x1875724578451456:12345-192.168.201.21@tcp:4:dd.0 00010000:00010000:3.0:1788830718.470251:0:16692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000224afb16/0x575506951eea21a8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830718.470269:0:16692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788830718.470273:0:16692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788830718.470280:0:16692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000224afb16/0x575506951eea21a8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830718.470300:0:16692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000224afb16/0x575506951eea21a8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788830718.476824:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830718.476943:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830718.476970:0:15150:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:0.0:1788830718.476979:0:15150:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_005' 00000100:00100000:0.0:1788830718.477091:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830718.477110:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1788830718.477137:0:15150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578451712 00000100:00100000:0.0:1788830718.477147:0:15150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578451712 00000100:00100000:0.0:1788830718.477197:0:15150:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:0.0:1788830718.477203:0:15150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578451840 00000100:00100000:0.0:1788830718.477206:0:15150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578451840 00000100:00100000:0.0:1788830718.477220:0:15150:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:0.0:1788830718.477227:0:15150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578451968 00000100:00100000:0.0:1788830718.477229:0:15150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578451968 00000100:00100000:0.0:1788830718.477376:0:15150:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:0.0:1788830718.477383:0:15150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875724578452096 00000100:00100000:0.0:1788830718.477386:0:15150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875724578452096 00000100:00100000:0.0:1788830718.478639:0:16693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 3 00000100:00100000:0.0:1788830718.478653:0:16693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2544ee5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5d08645c-98b4-449f-9d92-4c318beec94d+17:2352:x1875724578451584:12345-192.168.201.21@tcp:4:dd.0 00010000:00010000:0.0:1788830718.478775:0:16693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007ecfb759/0x575506951eea21af lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830718.478793:0:16693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788830718.478799:0:16693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788830718.478806:0:16693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007ecfb759/0x575506951eea21af lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830718.478820:0:16693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007ecfb759/0x575506951eea21af lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788830718.573413:0:15149:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 4194304 00002000:00010000:3.0:1788830718.573423:0:15149:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 1788830717 -> 1788830718 00002000:00010000:3.0:1788830718.573426:0:15149:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1788830717 -> 1788830718 00002000:00010000:3.0:1788830718.573429:0:15149:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 2051 00010000:00010000:3.0:1788830718.573443:0:15149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a3545b26/0x575506951eea219a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830718.573457:0:15149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a3545b26/0x575506951eea219a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830718.573477:0:15149:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a3545b26/0x575506951eea219a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830718.573485:0:15149:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e25658d7800 already unused, calling callback (ffffffffc14cb350) 00010000:00010000:3.0:1788830718.573490:0:15149:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a3545b26/0x575506951eea219a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830718.573499:0:15149:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a3545b26/0x575506951eea219a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830718.573520:0:15149:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a3545b26/0x575506951eea219a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830718.573528:0:15149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a3545b26/0x575506951eea219a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788830718.573618:0:15149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2544ee4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5d08645c-98b4-449f-9d92-4c318beec94d+25:2352:x1875724578451200:12345-192.168.201.21@tcp:4:dd.0 Request processed in 112616us (112813us total) trans 8589934598 rc 0/0 00000100:00100000:3.0:1788830718.573627:0:15149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 0 00000100:00100000:3.0:1788830718.573659:0:15149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 4 00000100:00100000:3.0:1788830718.574202:0:15149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25658dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5d08645c-98b4-449f-9d92-4c318beec94d+24:2352:x1875724578451712:12345-192.168.201.21@tcp:4:dd.0 00010000:00010000:3.0:1788830718.574253:0:15149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c70ad5d0/0x575506951eea21b6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830718.574267:0:15149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788830718.574279:0:15149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788830718.574286:0:15149:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c70ad5d0/0x575506951eea21b6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830718.574298:0:15149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c70ad5d0/0x575506951eea21b6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788830718.578637:0:7646:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934594 is committed 00000001:00080000:3.0:1788830718.578665:0:7646:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00000001:00080000:3.0:1788830718.578686:0:7646:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934597 is committed 00002000:00010000:1.0:1788830718.642519:0:16691:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 4194304 -> 5242880 00002000:00010000:1.0:1788830718.642531:0:16691:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 2051 -> 8199 00010000:00010000:1.0:1788830718.642548:0:16691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d5ca2b34/0x575506951eea21a1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830718.642574:0:16691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d5ca2b34/0x575506951eea21a1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830718.642583:0:16691:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d5ca2b34/0x575506951eea21a1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830718.642590:0:16691:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e257fa8de00 already unused, calling callback (ffffffffc14cb350) 00010000:00010000:1.0:1788830718.642594:0:16691:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d5ca2b34/0x575506951eea21a1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830718.642603:0:16691:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d5ca2b34/0x575506951eea21a1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830718.642624:0:16691:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d5ca2b34/0x575506951eea21a1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830718.642633:0:16691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d5ca2b34/0x575506951eea21a1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788830718.642769:0:16691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2544ee5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5d08645c-98b4-449f-9d92-4c318beec94d+22:2352:x1875724578451328:12345-192.168.201.21@tcp:4:dd.0 Request processed in 175910us (177792us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1788830718.642784:0:16691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 1 00000100:00100000:1.0:1788830718.642815:0:16691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 5 00000100:00100000:1.0:1788830718.642826:0:16691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25478b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5d08645c-98b4-449f-9d92-4c318beec94d+21:2352:x1875724578451840:12345-192.168.201.21@tcp:4:dd.0 00010000:00010000:1.0:1788830718.642859:0:16691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000007162624/0x575506951eea21bd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830718.642879:0:16691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788830718.642885:0:16691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788830718.642893:0:16691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000007162624/0x575506951eea21bd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830718.642905:0:16691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000007162624/0x575506951eea21bd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830718.643136:0:16692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000224afb16/0x575506951eea21a8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830718.643149:0:16692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000224afb16/0x575506951eea21a8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830718.643158:0:16692:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000224afb16/0x575506951eea21a8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830718.643166:0:16692:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2445f8ec00 already unused, calling callback (ffffffffc14cb350) 00010000:00010000:0.0:1788830718.643170:0:16692:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000224afb16/0x575506951eea21a8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830718.643178:0:16692:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000224afb16/0x575506951eea21a8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830718.643205:0:16692:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000224afb16/0x575506951eea21a8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830718.643213:0:16692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000224afb16/0x575506951eea21a8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788830718.643267:0:16692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2544ee6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5d08645c-98b4-449f-9d92-4c318beec94d+21:2352:x1875724578451456:12345-192.168.201.21@tcp:4:dd.0 Request processed in 173053us (178199us total) trans 8589934601 rc 0/0 00000100:00100000:0.0:1788830718.643276:0:16692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 2 00000100:00100000:0.0:1788830718.643297:0:16692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 6 00000100:00100000:0.0:1788830718.643306:0:16692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25478b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5d08645c-98b4-449f-9d92-4c318beec94d+20:2353:x1875724578451968:12345-192.168.201.21@tcp:4:dd.0 00010000:00010000:0.0:1788830718.643326:0:16692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a3545b26/0x575506951eea21c4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830718.643334:0:16692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788830718.643338:0:16692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788830718.643343:0:16692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a3545b26/0x575506951eea21c4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830718.643353:0:16692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a3545b26/0x575506951eea21c4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788830718.644372:0:16693:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 8199 -> 10247 00010000:00010000:3.0:1788830718.644386:0:16693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007ecfb759/0x575506951eea21af lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830718.644396:0:16693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007ecfb759/0x575506951eea21af lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830718.644405:0:16693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007ecfb759/0x575506951eea21af lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830718.644413:0:16693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e25658d7e00 already unused, calling callback (ffffffffc14cb350) 00010000:00010000:3.0:1788830718.644417:0:16693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007ecfb759/0x575506951eea21af lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830718.644425:0:16693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007ecfb759/0x575506951eea21af lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830718.644443:0:16693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007ecfb759/0x575506951eea21af lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830718.644459:0:16693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007ecfb759/0x575506951eea21af lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788830718.644565:0:16693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2544ee5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5d08645c-98b4-449f-9d92-4c318beec94d+20:2352:x1875724578451584:12345-192.168.201.21@tcp:4:dd.0 Request processed in 165912us (175499us total) trans 8589934600 rc 0/0 00000100:00100000:3.0:1788830718.644575:0:16693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 3 00000100:00100000:3.0:1788830718.644604:0:16693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 7 00000100:00100000:3.0:1788830718.644615:0:16693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e25478b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5d08645c-98b4-449f-9d92-4c318beec94d+19:2353:x1875724578452096:12345-192.168.201.21@tcp:4:dd.0 00010000:00010000:3.0:1788830718.644640:0:16693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008116829f/0x575506951eea21cb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830718.644650:0:16693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788830718.644653:0:16693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788830718.644658:0:16693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008116829f/0x575506951eea21cb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830718.644669:0:16693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008116829f/0x575506951eea21cb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788830718.644974:0:7646:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934600 is committed 00000001:00080000:3.0:1788830718.644989:0:7646:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934601 is committed 00010000:00010000:0.0:1788830718.683867:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788830718.693571:0:15149:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 5242880 -> 7654321 00002000:00010000:2.0:1788830718.693582:0:15149:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 10247 -> 14343 00010000:00010000:2.0:1788830718.693598:0:15149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c70ad5d0/0x575506951eea21b6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830718.693611:0:15149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c70ad5d0/0x575506951eea21b6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830718.693620:0:15149:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c70ad5d0/0x575506951eea21b6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830718.693636:0:15149:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2445f8e400 already unused, calling callback (ffffffffc14cb350) 00010000:00010000:2.0:1788830718.693641:0:15149:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c70ad5d0/0x575506951eea21b6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830718.693650:0:15149:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c70ad5d0/0x575506951eea21b6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830718.693686:0:15149:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c70ad5d0/0x575506951eea21b6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788830718.693693:0:15149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c70ad5d0/0x575506951eea21b6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788830718.693828:0:15149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25658dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5d08645c-98b4-449f-9d92-4c318beec94d+19:2352:x1875724578451712:12345-192.168.201.21@tcp:4:dd.0 Request processed in 120156us (217008us total) trans 8589934602 rc 0/0 00000100:00100000:2.0:1788830718.693839:0:15149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 4 00000001:00080000:3.0:1788830718.694826:0:7646:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934602 is committed 00002000:00010000:3.0:1788830718.742371:0:16692:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 14343 -> 16391 00010000:00010000:3.0:1788830718.742392:0:16692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a3545b26/0x575506951eea21c4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830718.742418:0:16692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a3545b26/0x575506951eea21c4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830718.742427:0:16692:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a3545b26/0x575506951eea21c4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830718.742433:0:16692:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e25658d7800 already unused, calling callback (ffffffffc14cb350) 00010000:00010000:3.0:1788830718.742437:0:16692:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a3545b26/0x575506951eea21c4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830718.742445:0:16692:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a3545b26/0x575506951eea21c4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830718.742465:0:16692:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a3545b26/0x575506951eea21c4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788830718.742471:0:16692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a3545b26/0x575506951eea21c4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830718.742513:0:16693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008116829f/0x575506951eea21cb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830718.742530:0:16693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008116829f/0x575506951eea21cb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830718.742536:0:16693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008116829f/0x575506951eea21cb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830718.742542:0:16693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2445f8fc00 already unused, calling callback (ffffffffc14cb350) 00010000:00010000:0.0:1788830718.742546:0:16693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008116829f/0x575506951eea21cb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788830718.742552:0:16692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25478b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5d08645c-98b4-449f-9d92-4c318beec94d+15:2353:x1875724578451968:12345-192.168.201.21@tcp:4:dd.0 Request processed in 99244us (265456us total) trans 8589934604 rc 0/0 00010000:00010000:0.0:1788830718.742553:0:16693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008116829f/0x575506951eea21cb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788830718.742562:0:16692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 6 00010000:00010000:0.0:1788830718.742564:0:16693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008116829f/0x575506951eea21cb lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788830718.742570:0:16693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008116829f/0x575506951eea21cb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788830718.742601:0:16693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25478b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5d08645c-98b4-449f-9d92-4c318beec94d+13:2353:x1875724578452096:12345-192.168.201.21@tcp:4:dd.0 Request processed in 97990us (265489us total) trans 8589934605 rc 0/0 00000100:00100000:0.0:1788830718.742608:0:16693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 7 00000001:00080000:0.0:1788830718.742632:0:7646:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934604 is committed 00000001:00080000:0.0:1788830718.742647:0:7646:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934605 is committed 00010000:00010000:1.0:1788830718.742688:0:16691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000007162624/0x575506951eea21bd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830718.742698:0:16691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000007162624/0x575506951eea21bd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830718.742705:0:16691:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000007162624/0x575506951eea21bd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830718.742738:0:16691:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e25820ff800 already unused, calling callback (ffffffffc14cb350) 00010000:00010000:1.0:1788830718.742743:0:16691:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000007162624/0x575506951eea21bd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830718.742750:0:16691:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000007162624/0x575506951eea21bd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830718.742762:0:16691:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000007162624/0x575506951eea21bd lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788830718.742781:0:16691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000007162624/0x575506951eea21bd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788830718.742819:0:16691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e25478b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5d08645c-98b4-449f-9d92-4c318beec94d+5:2352:x1875724578451840:12345-192.168.201.21@tcp:4:dd.0 Request processed in 99997us (265876us total) trans 8589934603 rc 0/0 00000100:00100000:1.0:1788830718.742827:0:16691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 5 00010000:00010000:2.0:1788830719.707922:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788830720.067217:0:16731:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:1.0:1788830720.731938:0:15935:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 29159 lines, 29159 kept, 0 dropped, 0 bad.